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Abstract 


Threaded discussions represent conversational turn-taking in asynchronous, online 
learning environments. Given the crucial role that discussions play in the construction of 
knowledge within an online course, the quality of the interaction that occurs within 
threaded discussions is important to achieving the learning objectives of the designed 
instruction. Despite this importance, research has consistently demonstrated that the 
threaded discussions could offer more substantial benefit to learning in constructivist 
environments. Three variables, two of which were considered elements of course design, 
were examined relative to threaded discussions: intersubjectivity, cognitive requirement 
of prompt (CROP), and time in course (TIC). Intersubjectivity is the representation of 
knowledge construction achieved through a synergistic progression from individual 
contributions to sequences of interdependent contributions. This variable was measured 
using the Interaction Analysis Model, a tool of content analysis developed in 1997 
through a grounded theory approach. CROP was defined as the highest category in the 
cognitive process dimension of Bloom‘s revised taxonomy that was required within the 
response to a discussion prompt. TIC was the amount of course time that had elapsed 
before a particular message was posted to the discussion board, calculated as the 
percentage of course completion at the time the response was made. Peer responses 
(«=167) were examined from a wholly online communications course offered through an 
accredited community college. Both elements of course design, CROP and TIC, were 
found to have significant, positive correlations with intersubjectivity as a measure of 
quality in online classroom discourse. As online course delivery continues to grow, the 
challenge for instructional designers is the identification and implementation of those 



course elements whieh faeilitate intersubjeetivity in online courses. This study 
demonstrated that the cognitive requirement of prompt and time in course are two 
elements that are related to the quality of discourse within threaded discussions. The 
initial prompt is one of the first pieees of scaffolding necessary for the knowledge 
construction requisite in a constructivist learning environment. Instructional designers 
should eontinue to recognize that the strength of the construetion of knowledge, as 
evidenced in the threaded diseussion, depends upon the strength of the seaffolding that 
supports that construetion. 
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CHAPTER 1. INTRODUCTION 


Since the seeond half of the last eentury, there has been a eall for a paradigm shift 
in edueation from standardization to eustomization (Reigeluth,1999) and from the 
instruetor-eentered model focused on the dissemination of knowledge to the leamer- 
eentered model foeused on the eonstruetion of knowledge (Reigeluth & Carr-Chellman, 
2009). Coneurrent with this eall has been the growth of degree programs offered in 
wholly online formats (Allen & Seaman, 2010). In online eourse rooms that seek to 
faeilitate knowledge eonstruetion, the discussion board is the most common space in 
whieh this eollaborative knowledge eonstruetion is demonstrated (Calvani, Fini, Molino, 
& Ranieri, 2010). Furthermore, Gibson (2009) asserted that discussion-based teaehing 
^verses the foeus of the industrial-age paradigm by emphasizing learning as the 
priority, not teaching” (p. 102). Given the prominent role that these discussion areas play, 
Makitalo-Siegl (2009) ealled the diseussion boards the Aife blood and eenter of energy” 
(p. 55) for the online eourse. 

These areas usually take the form of threaded diseussions, whieh represent a 
Aiierarehieally organized eolleetion of notes in whieh all notes but one (the note that 
started the thread) are written as _Kplies‘ to earlier notes” (Hewitt, 2005, p. 568). This 
structure represents eonversational turn-taking in asynehronous discussions. Given the 
role of the threaded diseussion in the eonstruetion of knowledge that oeeurs within an 
online course (Calvani et ah, 2010), the interaetion that oeeurs within threaded 
diseussions is important to aehieving the learning objeetives of instruetion situated within 
a eonstruetivist environment. Sueeessful knowledge eonstruetion requires -aetive and 
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broad participation” (Sing & Khine, 2006, p. 254) occurring at a higher level than surfaee 
interaetion, as noted by Dennen and Wieland (2007). Knowledge construction at this 
more advanced level of interaetion oceurs through the opportunities for eognitive 
engagement required for the higher-order learning proeesses indicated by Bloom's 
taxonomy (Bloom & Krathwohl, 1956). Interaetion alone neither produees nor 
demonstrates knowledge eonstruetion consistent with a construetivist perspeetive (Hall, 
2010b). Thus, while interaetion is inherent in constructivist learning, it is feasible to take 
interaetion to a higher level known as intersubjeetivity (Dennen & Wieland, 2007; 

Martin, Sokol, & Elfers, 2008). 

Intersubjeetivity represents the higher quality of synthesis represented in 
interactions needed to achieve the knowledge eonstruetion required in a eonstructivist 
environment and can be defined as the representation of knowledge construction 
achieved through a synergistic progression from individual contributions to sequences of 
interdependent eontributions. Intersubjeetivity relates to the eoordination of individual 
contributions during the activity, thereby ereating -eontinuity in activity progression” 
through -building on each other's eontributions” (Matusov, 1996, p. 41). Similarly, 
Bober and Dennen (2001) defined intersubjeetivity as the development of shared 
understanding that relates one situation to another, relying on artifaets ereated by the 
ongoing conversation to develop new eontributions to the discourse. 

However, as shown by the following studies, course room discourse among 
learners has consistently lacked this higher level of quality. Rather than the -sequenees 
of dependeneies” (Suthers, 2006, p. 4) required for intersubjeetivity, researchers 
eategorize student contributions as distinct presentations (Henri, 1992), information 


2 



exchange (Salmon, 2000), exploration (Garrison, Anderson, & Archer, 2001), shared 
stories (Romeo, 2001), serial monologues (Pawan, Paulus, Yalcin, & Chang, 2003), 
consecutive online notes (Hewitt, 2005), or superficial postings (Bures, Abrami, & 
Schmid, 2010; Ke, 2010). The learners themselves share this disappointment in the 
quality of online discussions, according to Chang (2003), who found that two thirds of 
students considered the discussions to be of insufficient value in supporting their 
learning. 

Many factors influence intersubjectivity within the threaded discussions of online 
courses. As online course delivery continues to grow (Allen & Seaman, 2010), the 
challenge for instructional designers is the identification and implementation of those 
course elements which facilitate intersubjectivity in online courses situated within a 
constructivist framework. Two particular course elements that may influence 
intersubjectivity are cognitive requirement of prompt (CROP) and time in course (TIC). 
CROP is the level of thinking that should be evident in a response, indicated by the 
highest level of Bloom‘s revised taxonomy required to answer the discussion prompt. 

TIC is the amount of course time that has elapsed before a particular message was posted 
to the discussion board, as indicated by percent of course completed at the time the 
response is made. Some questions emerge about these elements of course design. What 
kinds of prompts lead to greater levels of intersubjectivity within the responses? Does 
intersubjectivity change at different points in time within a course? The study addressed 
these questions by measuring the connection between intersubjectivity and two aspects of 
the online course: the cognitive requirement of the prompt (CROP) and time in course 
(TIC). 
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This chapter provides a background for the study, a concise statement of the 
problem whieh this study seeks to address, the purpose and rationale of the study, the 
researeh questions, the nature and significance of the study, and the assumptions and 
limitations of the research. 


Background of the Study 

The question of how to inerease and enhance the quality of interaction has been 
an important researeh goal (Hannafin, 1999). In a survey of researeh artieles in the 20th 
century, Berge and Mrozowski (2001) concluded that one of the three topics addressed 
most often was how to increase interaetivity. Parker (2004) aceurately stated that -the 
greatest challenge for trying to define quality in any product or service is that quality 
remains a relative experienee, realized in large part through an individuaPs level of 
expectation” (p. 387). While the exact definition of quality may be subjective, the quality 
of online threaded discussions has failed over the last two decades to meet the level of 
expectation of many individual researchers within the field. 

The quality of online diseourse emerged as a researeh question in the late 20* 
century. Henri (1992) noted that -edueators are not making use of the content of 
[eomputer-mediated communication] exchanges to further the learning process” (p. 1 14). 
Two years later. Wan and Johnson (1994) and Ackermann (1994) noted that learners 
often post only a single reply, rather than engaging in a more robust discussion of the 
course topic. Likewise, Kara, Bonk, and Angeli (2000) found that students posted about 
one message per week and the resulting discussions reflected one-way, rather than two- 
way, interaction. Consistent with the oceurring shift from quantitative to qualitative 
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standards of online discourse, Duffy, Dueber, and Hawley (1998) argued for a shift in 
assessment from the structure of thinking to the quality of thinking. For example, the 
presentation of evidence is a structural component of an argument. If a post was judged 
strictly on the presence of evidence, the learner's post would be considered to have met 
the standard. However, if the quality of thinking was considered to be a more important 
component of assessment than the mere presence of any evidence, as Duffy et al. argued, 
the post would be judged in terms of the quality of that evidence, such as the credibility 
of the source and its relevance to the topic under discussion. Guzdial and Turns (2000) 
continued the call for quality discourse, recognizing that online discussions are often not 
sustained over time, lack broad participation, and veer away from course topics. 

Research relating to the quality of online discourse continued into the first five 
years of this century. Jarvela and Hakkinen (2002) noted that the results of many studies, 
including their own, indicated low-level discussions that are -superficial and egocentric” 
(p. 15). In a study of their Framework of Evaluating Participation: Quality of 
Interaction, Khine, Yeap, and Lok (2003) found that the majority of participants did not 
exhibit critical thinking and that nearly half of the messages posted by participants were 
independent statements that were not in reference or connected to prior messages (see 
Henri, 1992). Similarly, Pawan et al. (2003) described the majority of the online course 
discussions as focused on -the presentation of positions rather than in inquiry” 
(Instructional Factors and Pedagogical Interventions, para. I). The learners themselves 
shared this disappointment in the quality of online discussions according to Chang 
(2003), who found that 65% of students considered the online course discussions to be of 
insufficient value in supporting their learning. Hewitt (2005) called the need for ^nore 
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educationally worthwhile online discussions” a persistent and widespread problem” (p. 
569). 

This problem has persisted within the last five years. Wickersham and Dooley 
(2006) called much of online discussion the illusion of participation” (p. 186) and called 
for additional research on quality in online discourse. Similarly, Spatariu, Quinn, and 
Hartley (2007) considered studies improving the quality of online discourse as a ^ajor 
research gap” (p. 44). Kanuka, Rourke, and Lafiamme (2007) found that the discourse in 
their study was — nbrefiective . . . rarely went further than what was required . . . [and] 
resulted in desiccated discussions” (p. 267) that ^sembled a document delivery system” 
(p. 268). Bradley (2008) also noted that the -quality of online discussion can be 
improved” and that -very little research has been conducted in this area” (p. 889). In 
their research on the relationship between motivation and quality discourse, Zhang, 
Koehler, and Spatariu (2009) noted the Hower levels of student reasoning in online 
discussions” (p. 195). In their investigation of a semantic forum for collaborative 
learning, Li, Dong, and Huang (2009) also noted the lack of ^igh-quality discourse” (p. 
71) in the traditional online forum. Wise (2009), in considering reference points in the 
development of shared context, also recognized the problem of How-quality interactions 
in online conversations” (p. 317). Even in an online course on critical thinking, 
Thompson (2009) noted that students often wrote -short, underdeveloped summaries” (p. 
7). Jorcak and Bart (2009) continued to substantiate the need for intersubjectivity among 
discussion posts in order to construct group knowledge that is indicative of higher order 
thinking (Bloom & Krathwohl, 1956). 
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Despite extensive researeh over the last decade, quality in online discourse 
remains inconsistent and ephemeral. If intersubjectivity is the representation of 
knowledge construction achieved through a synergistic progression from individual 
contributions to sequences of interdependent contributions, then the opportunity certainly 
exists to identify those elements which influence intersubjectivity within these course 
room discussions (Boulter, 2010; Wang, Woo, & Zhao, 2009; Wruck, 2010). As online 
course delivery continues to grow (Allen & Seaman, 2010), the challenge for 
instructional designers is the identification and implementation of those course elements 
which facilitate intersubjectivity in online courses. Two such elements may be the 
cognitive requirements of prompts (CROP) used to elicit learner responses (Andresen, 
2009; Donnelly, 2010; Gilbert & Dabbagh, 2005) and the time spent within the course 
term, or time in course (TIC; see Boulter, 2010; Christopher, Thomas, & Tallent- 
Runnels, 2004). 

One element that may influence the quality of course room discourse, and the 
subsequent achievement of intersubjectivity, is the cognitive requirement of the initial 
prompt (CROP) (Andresen, 2009; Donnelly, 2010; Gilbert & Dabbagh, 2005). 
Questioning, a particular kind of prompt, is an instructional device in directing student 
thinking through productive discussion” (Wang, 2005, p. 304). From this definition 
arises the possibility of different ways to design prompts, as instructional devices or 
strategies, which influence student thinking. Indeed, nearly two decades ago, Rosenshine 
and Meister (1992) demonstrated that different types of question prompts elicit different 
responses and may lead to different learning effects. More recently, Wruck (2010) 
suggested that instructional designers could modify discussion questions in order to 


7 



influence learner responses. The recognition that CROP exerts an influence on learning 
calls for a way to group prompts so that they can be examined for their influence on 
subsequent discussion. 

Many ways exist to categorize the multiple prompts designed within instructional 
materials for the purpose of generating and guiding course discussions. One way is to 
apply Bloom's taxonomy (Bloom & Krathwohl, 1956) of educational objectives, as done 
in a study by Christopher et al. (2004). Thus, an examination of the influence of CROP, 
as categorized using Bloom's taxonomy, on course room discussions is situated within 
the published literature. 

The research literature has also considered time as another factor influencing 
discourse in online course rooms. Time has been explored in several ways, including 
comparing traditional and accelerated courses (Anastasi, 2007; Daniel, 2000; Kretovics, 
Crowe, & Hyun, 2005; Kucsera & Timmaro, 2010; Poellnitz, 2008; Seaman, 2004), day 
of posting and thread growth (Hewitt, 2005; Jeong & Frazier, 2008), time delay between 
postings (Cheung, Hew, & Ng, 2008; Garrison, Anderson, & Archer, 2000; Huntley & 
Thatcher, 2008; Pendergast, 2006; Tu, 2002), and changes from the beginning to the end 
of the course (Boulter, 2010; Christopher et ah, 2004). Published studies suggest that the 
development of threaded discussions is related more to the time at which a message was 
posted than to the content of the message. However, the number of peer responses does 
not indicate the quality of those responses (Wruck, 2010). The coordination of 
perspectives evidenced within the content of the message is what determines whether or 
not intersubjectivity has been achieved (Dennen & Wieland, 2007; Wertsch, 1985). 
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Another way that time might influenee course room discourse is at different 
points within the course. While research has considered changes in threaded discussions 
between the beginning and end of courses (Boulter, 2010; Christopher et ah, 2004), many 
other points of time exist throughout the progression of a course. Does intersubjectivity 
look different at these multiple points in the course? The abundance of courses with 
varying lengths makes it difficult to examine intersubjectivity along these multiple points 
and across courses. In order to make accurate comparisons across courses of different 
lengths, time in course (TIC), which is measured as a calculated percentage of course 
completion, could be used. 


Statement of the Problem 

With the content of discussion posts ranging from substantive to irrelevant, the 
problem to be investigated by this study is the lack of consistent quality in learner-to- 
leamer discussion board interactions. 

One way to measure the quality of discussion posts is the level of collaborative 
knowledge construction, or intersubjectivity, achieved within the post (Dennen & 
Wieland, 2007; Penny & Murphy, 2009). Although the continued growth of online 
courses (Allen & Seaman, 2010) calls for a thorough understanding of the instructional 
design elements that influence intersubjectivity, the opportunity to examine many of 
these influential factors still exists (Boulter, 2010; Wang, Woo, & Zhao, 2009; Wruck, 
2010 ). 
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Purpose of the Study 


The purpose of the study was to investigate the relationships between 
intersubjeetivity, as a measure of the quality of interaetion in eourse room diseourse, and 
(a) eognitive requirement of prompt (CROP) and (b) time in eourse (TIC) within the 
threaded discussions of online course rooms. 

Rationale 

A significant element for understanding the purpose of the study is establishing 
the connections between the design of the prompt and the dialogue that ensues. These 
connections have been established through the literature. According to Lim (2004), the 
communication that occurs in any learning environment is the most important aspect of 
the educational process that happens in that environment. Lim‘s assertion is consistent 
with social constructivism (Vygotsky, 1978), which acknowledges that interaction 
through dialogue is crucial to cognitive development. Since the majority of the dialogue 
in the online learning environment occurs through the discussion boards (Jeong, 2003; 
Schwartman, 2006; Thompson, 2009), learners who engage these discussion boards 
should be able to achieve a high level of cognitive processing (Thomas, 2002). The term 
intersubjeetivity has been used to describe the result of learner-to-learner coordination 
within their individual, cognitive perspectives (Dennen & Wieland, 2007). An effective 
means of determining the level of cognitive process is Bloom‘s taxonomy (Jorgensen, 
2009). Effectively planning the use of discussion boards is important in achieving this 
high level of cognitive engagement (Tu & Corry, 2003), and one element of planning for 
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cognitive engagement is the design of the initial discussion prompts (Asherian, 2007; 
DeLoach & Greenlaw, 2007). Therefore, additional researeh on these conneetions was 
warranted. 


Research Questions 

The purpose of the study was to investigate the relationships between 
intersubjectivity, as a measure of the quality of interaetion in eourse room discourse, and 
(a) cognitive requirement of prompt (CROP) and (b) time in course (TIC) within the 
threaded discussions of online course rooms. There were two research questions. 

1 . What is the association between intersubjectivity and cognitive requirement of 
prompt (CROP) within the threaded discussions of online eourse rooms? 

2. What is the association between intersubjeetivity and time in eourse (TIC) 
within the threaded discussions of online course rooms? 

Answers to these researeh questions addressed the stated problem of ineonsistent quality 
in course room discourse by offering information about what relationship exists between 
the two elements of instructional design (eognitive requirement of prompt and time in 
course) and the identified measure of quality in course room discourse (intersubjeetivity). 

Nature of the Study 

The researeh used a quantitative methodology to consider intersubjeetivity, cognitive 
requirement of prompt (CROP), and time in course (TIC) within the discussion board of 
an online eourse. The explanatory eorrelational design employed content analysis, 
speeifically the Interaction Analysis Model (lAM) of Gunawardena, Lowe, and Anderson 
(1997), to measure the intersubjeetivity of student responses posted to the discussion 


11 



boards. As illustrated in Figure 2, the lAM has been used consistently, and increasingly, 
since its development. CROP was determined by the level of Bloom's revised taxonomy 
(Anderson & Krathworthl, 2001) required in a response to the prompt. TIC was 
calculated as the percentage of time that had elapsed between the beginning of the course 
term and the date on which a message was posted. The study included all peer responses 
within the threaded discussions of a wholly online course offered at an accredited 
community college. There were two raters to ensure reliability of coding. Inter-rater 
reliability was established through training and the two raters coding one set of data, 
measuring the reliability of coding, then discussing and resolving differences. There was 
no affiliation between the coders and the course in which the data were collected. 

Significance of the Study 

The process of knowledge sharing is different than its outcome (Reich, 2010). As 
online course delivery continues to grow (Allen & Seaman, 2010), instructional designers 
will have increasing opportunities to design learning activities that promote quality 
course room discourse. Rather than relying on heuristics (Silber, 2007; Woo & Reeves, 
2007), instructional designers would benefit from the development of research-based 
principles on which to design the prompts directing the initial course room discussions. 
The purpose of the study was to investigate the relationships between intersubjectivity, as 
a measure of the quality of interaction in course room discourse, and (a) cognitive 
requirement of prompt (CROP) and (b) time in course (TIC) within the threaded 
discussions of online course rooms. This study added research to the knowledge base of 
instructional design by offering information about the relationship between the two 
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elements of instruetional design (CROP and TIC) and the identified indieator of quality 
in eourse room discourse (intersubjectivity). 


Assumptions and Limitations 

There were several assumptions and limitations of the study, including its 
theoretical framework and generalizability. These limitations are more thoroughly 
discussed in Chapter 5. 

This study has four assumptions. The study is framed by social constructionism, 
a learning theory the lineage of which can be traced from Kant (1781/2007) through 
Piaget (1952), Vygotsky (1978), and Papert (1991). Thus, one assumption of this study is 
the validity of the theoretical framework upon which it rests. The manifestation of and 
ability to detect evidence of knowledge construction within course room discussions are 
further assumptions. Another assumption of the study is that the design of the instruction 
influences the extent of knowledge construction that occurs within these discussions. 

This study has three limitations. Two limitations are related to generalizability. 
The extent to which the results can be generalized to programs beyond the level of the 
institution (associate's degree) is one limitation. For example, learners could respond 
differently to the initial discussion prompts in bachelor, master's, or doctoral programs. 
The ability to generalize beyond the knowledge domain or the course topic 
(communication) examined is a further limitation. For example, learners could respond 
differently to the initial discussion prompts in courses on other topics, such as education 
or human services. Another limitation is the explanatory correlational design, which 
measures the degree of association but offers no predictive or causal descriptions. 
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Deflnition of Terms 


Several terms are used in preeise ways within this study. Therefore, those terms 
are defined here. 

Cognitive requirement of prompt (CROP). The level of thinking that is 
required in a response; measured as the highest level of Bloom‘s revised taxonomy 
required within the response to a diseussion prompt. This definition is supported by 
Wang‘s (2009) assertion that the ^vel of student thinking is direetly proportional to the 
level of questions asked” (p. 310) and that higher-order thinking is represented in the top 
three levels of Bloom‘s taxonomy. Similarly, Christopher et al. (2004) also eategorized 
diseussion prompts aeeording to Bloom's taxonomy. 

Higher-order thinking. Aetions represented within the top three levels of 
Bloom's revised taxonomy (Anderson & Krathworthl, 2001): analyze, evaluate, or ereate. 
This definition is supported by multiple studies, ineluding Boulter (2010) and Wruek 
( 2010 ). 

Intersuhjectivity. The representation of knowledge eonstruetion aehieved 
through a synergistie progression from individual eontributions to sequenees of 
interdependent eontributions. This definition was eonstrueted from the initial definitions 
of intersubjeetivity presented in philosophy (Husserl, 1931), soeiology (MeMahon, 

1999), and psyehology (Fisek, 2010; Natterson, 1993). 

Prompt, A statement, question, or other deseription of the topie to whieh learners 
should respond in their initial diseussion post (Brown & Green, 2009). 

Threaded discussion. A Hiierarehieally organized eolleetion of notes in whieh 
all notes but one (the note that started the thread) are written as _ieplies' to earlier notes” 
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(Hewitt, 2005, p. 568) and represent -well-defined, easily identifiable artifaets [in whieh] 
the reply protoeol roughly aligns with the notion of eonversational tumtaking” (p. 568). 

Time in course (TIC). The amount of time that elapsed before a partieular 
message was posted to the discussion board and was measured using percentage of 
course completion. This percentage is calculated using a procedure similar to that 
outlined in 34CFR668.22(f)(l)(i) for determining period of enrollmenf’ for the 
treatment of Title IV grant or loan funds. Thus, the total number of calendar days 
completed prior to the date on which the message was posted to the discussion board is 
divided by the total number of calendar days of the length of the academic term. The 
result is rounded to the nearest whole number. 

Organization of the Remainder of the Study 

The remainder of the study is discussed in the following chapters. The theoretical 
framework for the study and significant literature related to each element of the 
correlation are examined in Chapter 2. The methodology of the study is explained in 
Chapter 3, including the research design and strategy, measures of the variables and the 
validity and reliability of the selected instrument, data collection, and anticipated 
analysis. The data collection techniques and data analysis findings are described in 
Chapter 4. The study's conclusions, significance, and limitations, as well as suggestions 
for future research, are discussed in Chapter 5. 

Summary 

With the content of discussion posts ranging from substantive to irrelevant, the 
problem investigated by this study was the lack of consistent quality in discussion board 
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interactions. Although the continued growth of online courses (Allen & Seaman, 2010) 
calls for a thorough understanding of the instructional design elements that influence 
intersubjectivity, the opportunity to examine many of these influential factors still exists 
(Boulter, 2010; Wang, Woo, & Zhao, 2009; Wruck, 2010). The purpose of this study 
was to investigate the relationships between intersubjectivity, as a measure of the quality 
of interaction in course room discourse, and (a) cognitive requirement of prompt (CROP) 
and (b) time in course (TIC) within the threaded discussions of online course rooms. 

This study added research to the knowledge base of instructional design by offering 
information about the relationship between the two elements of instructional design 
(CROP and TIC) and the identified indicator of quality in course room discourse 
(intersubjectivity). The assumptions and limitations of the study are related to its 
theoretical framework and generalizability. The theoretical framework for the study and 
each element of the correlation (intersubjectivity, CROP, and TIC) are reviewed in the 
next chapter. 
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CHAPTER 2, LITERATURE REVIEW 


The purpose of the study was to investigate the relationships between 
intersubjeetivity, as a measure of the quality of interaetion in course room discourse, and 
(a) cognitive requirement of prompt (CROP) and (b) time in course (TIC) within the 
threaded discussions of online course rooms. This section reviews the theoretical 
framework of the study, which is social constructionism and its roots in constructivism, 
and the three variables (intersubjeetivity, cognitive requirement of prompt, and time in 
course) between which relationships were investigated. 

Social Constructionism 

The importance of the discussion post in online learning is rooted in social 
constructionism, a learning theory the lineage of which can be traced from Kant 
(1781/2007), Piaget (1952), Vygotsky (1978), and Paper! (1991). An understanding of 
the origins of constructivism, and the subsequent departure of social constructionism, 
provides the theoretical framework for this study. Each distinction between the theories 
contributes something unique to the framework of this study. 

Constructivism 

Constructivism emerged from Immanuel Kant‘s (1781/2007) philosophical 
position that the only known reality is that which can be represented by human thought. 
The term — postejstemological” (Noddings, as cited in von Glaserfeld, 1995) has been 
used to refer to the way in which constructivism has evolved beyond its philosophical 
roots. As it expanded into the realm of education, constructivism came to be understood 
as both a theory of knowledge and a theory of learning. This dual recognition is important 
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to this study because the discussion board within an online course is where learning is 
prompted and knowledge is demonstrated. 

In short, the theory of constructivism asserts that knowledge is actively 
constructed rather than passively received. This theory represented a monumental shift 
away from the idea that knowledge can be disseminated and acquired and toward the 
recognition of the value of experience in learning. Constructivism can be divided into 
cognitive constructivism, based extensively on the work of Jean Piaget, and social 
constructivism, based on the derivative work of Lev Vygotsky. In order to fully 
understand how social constructionism framed the study, it is necessary to explore 
cognitive and social constructivism from which social constructionism emerged. 

Cognitive constructivism. As a psychologist, Piaget built his theory from the 
philosophical foundations of Kant (1781/2007). Just as Kant asserted that knowledge 
cannot be represented outside of human thought, Piaget (1952) asserted that the 
relationship between an individuaPs conceptual structures and the individuaPs 
experiential world was not one of representation of an independent reality, but of 
adaptation based on previously constructed perceptions (Von Glaserfeld, 1996). The 
term cognitive equilibration was developed by Piaget to account for his idea of a constant 
balancing process between assimilation and accommodation. Assimilation refers to 
organizing experiences within a learner ‘s current understanding, while accommodation 
refers to the modification of current understanding as the learner experiences 
contradictions (Fosnot, 1996) or anomalies (Driscoll, 2005). This process of 
equilibration was used by Piaget to describe how an individual moved from one 
developmental stage to the next, until the end stage of formal operations was reached. 
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Social constructivism. Lev Vygotsky agreed with Piaget‘s developmental 
theories to a certain extent. However, Vygotsky (1978) rejected the idea of specific, 
invariant stages of development and argued that development depended on more than the 
individual equilibration process of Piaget (Driscoll, 2005). Thus, although a derivative of 
cognitive constructivism, social constructivism diverges in several ways. 

One difference is the way cognitive constructivism focuses on the cognitive 
structuring process of the individual (Fosnot, 1996), while social constructivism 
emphasizes the sociocultural effects of the environment on the cognitive structuring 
process. A second difference is Vygotsky‘s (1978) emphasis on social interaction, as 
seen in his stress on dialogue, beyond Piaget's focus on contradiction and equilibration. 
This difference is important to this study, which examines the interaction that occurs 
through the discussion threads. It is through the discussion board that contradictions to 
individual constructions are presented, thereby triggering the process of accommodation. 
Another difference is Vygotsky's differentiation between concepts as either spontaneous 
or scientific. For Vygotsky, spontaneous concepts were those that occurred naturally 
through interactions with the environment, like learning language (Fosnot); these are the 
kinds of concepts that Vygotsky claimed were relevant to Piaget's (1952) idea of 
equilibration. Scientific concepts, however, were more logically defined abstractions that 
required formal, structured activities to learn. The range of interactions in an online 
discussion board includes both spontaneous and scientific concepts in the Vygotskian 
interpretation. 

Von Glaserfeld (1995) offered a bridge between cognitive and social 
constructivism by noting Piaget's (1973) acknowledgement that the causes of 
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disequilibrium most often were found through interaetions with others. Thus, soeial 
interactions, as emphasized by Vygotsky (1978), offer important opportunities for 
Piaget‘s (1952) process of adaptation, through accommodation or assimilation, to occur. 
In an online course, this process is prompted by and demonstrated through dialogue 
within the discussion threads. Whereas cognitive constructivism sees conceptual 
reorganization as the primary process of learning, social constructivism sees social 
enculturation as the primary process of learning. While followers of one type of 
constructivism consider theirs to be the primary process, they are also obliged to 
acknowledge the contributions to learning offered by the other type of constructivism. 
That is, as Cobb (1996) stated, is as if one perspective constitutes the background 
against which the other comes to the fore” (p. 45). Thus, in terms of this study, advocates 
of either cognitive or social constructivism would have to acknowledge the role of the 
discussion board in the construction of knowledge. 

In summary, constructivism is a learning theory derived from the work of Kant 
(1781/2007). Piaget's (1952) theory of assimilation builds on Kant's epistemology by 
suggesting that the equilibrium sought biologically is also sought cognitively. 
Development is equated with learning, and each stage of development, hence learning, 
occurs as equilibrium is achieved repeatedly. Vygotsky (1978) extended Piaget's work 
by emphasizing the socio-cultural effects, notably dialogue, on the processes of 
assimilation and accommodation from which equilibrium is achieved. The framework of 
the study was built on these ideas because the study recognized the importance of 
dialogue in the construction of knowledge. There was one more element to the 
framework for this study, however, that pushed past social constructivism into social 
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constructionism. Just as cognitive constructivism and social constructivism are 
derivatives of the larger concept of construetivism, so also is soeial eonstruetionism 
derived from social constructivism. This relationship is illustrated in Figure 1 . 



Figure 1. Relationship of theories and their contributions to the framework of study. 


Constructivism contributes the broad theory that knowledge is ereated. As derivatives of 
eonstructivism, eognitive eonstructivism eontributes the eoneept of equilibrium and 
soeial construetivism contributes the importanee of dialogue. From soeial constructivism 
comes soeial eonstruetionism and its contribution through the importance of artifaets. 

Social Constructionism 

Seymour Papert is eredited with the foundation of eonstruetionism. Papert spent 
five years (1959-1964) working with Piaget at the Center for Genetie Epistemology 
(Papert, 1980). Derived from Piaget's (1952, 1973) original eonstruetivism, soeial 
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constructionism was developed as -et new elaboration of the old idea of learning by 
doing” (Harel & Papert, 1991, p. 41). Impressed by Piaget's thinking of children as 
active knowledge builders, Papert wondered from what materials was this knowledge 
being built. Although the suggestion sounds humorous that construetionism descended 
from a soap-sculpture model (Papert, 1991), the model itself and the style in whieh other 
students approaehed their work were inspirational in the development of constructionism. 

Constructionism rests on the idea that what first develops within an individual is 
the preferenee for a certain proximity to objeets. From this preference for a particular 
degree of closeness to objeets follows the individual's propensity to use abstract or 
concrete styles of thinking (Turkle & Papert, 1991). Thus, in constructionism, this 
proximity to objects is seen as another way to appropriate formal systems that allows for 
valid alternatives to abstract thinking. While Piaget's (1952) theory of development 
moved from the conerete to the formal, Papert (1980) asserted that formal reasoning is a 
style, not a stage. From a constructionist perspective, intellectual style refers to ways of 
thinking that keep people either close to or distant from objeets. As such, 
constructionism suggests that a preferenee toward the eonerete and relational intellectual 
style assoeiated with a elose relationship to objects is as equally valid as the abstract and 
analytical style associated with a distant relationship from objects. 

While both eonstructivism and construetionism view learning as an act of 
constructing knowledge (Aekermann, 2001), constructionism goes on to suggest that 
learning occurs when the learner is construeting a ^ublie entity” (Harel & Papert, 1991, 
p. 1). The ^ublie entity” is the object, or artifact (Kafai & Resnick, 1996), which 
distinguishes soeial constructionism from social constructivism. Examples of such 
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objects in Papert‘s work included gears and turtles (Harel & Papert). The key is that the 
entity, artifact, or object is public, meaning it is both external and sharable. In this study, 
the created object or artifact was the threaded discussion, an object which is both external 
to the individual and shared with the public, conceived of as the other members of the 
course room. Indeed, Hewitt (2005) called the threaded discussions -well-defined, easily 
identifiable artifacts” (p. 568). Similarly, in their study of reference points. Wise, 
Padmanabhan, and Duffy (2009) suggested that objects do include initial discussions and 
subsequent exchanges in online discourse. The emphasis on objects is a key point of 
distinction between constructivism and constructionism. 

Not only are ideas made, instead of transmitted, and not only are these ideas more 
likely to emerge during the construction of an artifact, these ideas are more likely to 
emerge because the process and the outcome of construction are personally meaningful to 
the learner. In addition, reflection, considered essential in adult learning (Mackeracher, 
2004), is easier when there is an artifact on which to reflect. This newly created artifact 
then serves as material for future reflection and, subsequently, knowledge refinement and 
construction. 

This led to Papert‘s recognition of affect and culture. Papert (1980) varied from 
Piaget (1952, 1973) in the role he attributed to the culture as a source of the materials - 
the entities, artifacts, and objects - needed for the building of intellectual structures. The 
acquisition of language serves as a good example of how cultural materials stimulate 
learning. When materials, like verbal speech, are present in the culture, complex and 
formal learning, such as is required for language, is spontaneous because there are plenty 
of opportunities for the learner to experience the language concepts in simple and 
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concrete ways. When these materials are not provided by the eulture, sueh as trying to 
learn a foreign language without being immersed in a loeation where that language is 
spoken, deliberate, formalized instruetion is required (Papert). In terms of this study, 
when a threaded discussion achieves intersubjeetivity, meaning multiple perspeetives 
have been presented and negotiated within the dialogue, the learner has more 
opportunities for spontaneous learning beeause he or she is immersed in a course room 
eulture that is filled with the neeessary materials for the eonstruetion of knowledge within 
that particular subject area. 

Soeial eonstruetionism supports the existenee of multiple ways of knowing. 

Papert (1980) eountered established diehotomies between ways of knowing, sueh as faets 
versus skills, ^^nowing that” versus Renewing how,” or propositional knowledge versus 
proeedural knowledge. Papert (1991) did aeknowledge his — vadetta against the idea of 
any single explanation for mental phenomena” (p. 18). Similarly, Jonassen (1999) noted 
that "to impose a single belief or perspective is deeidedly noneonstructivist” (p. 217). 
Aeeepting the validity of multiple ways of knowing and thinking, as suggested by 
eonstruetionism' s emphasis on proximity to objects, allows for an epistemological 
pluralism (Turkic & Papert, 1991) that is important to consider when approaching the 
design of instruction. 

In summary, the study is framed by social constructionism and its emphasis on 
artifacts. The emphasis on objects that is presented by social constructionism is a key 
distinction from its superordinate theories of social constructivism and constructivism 
writ large. The discussion thread of an online course room, which was the focus of this 
study, was the object (social constructionism) that provided the materials for the process 
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of adaptation (cognitive constructivism) through social interaction and dialogue (social 
constructivism). With an understanding of the theoretical framework for the study, and 
specifically how this framework supports the threaded discussion as the focus of the 
study, attention can be turned toward each of the variables in the study. 

Intersubjectivity 

The outcome variable in the study was intersubjectivity. While interaction is 
inherent in all the forms of constructivist learning, intersubjectivity takes interaction to a 
higher level (Dennen & Wieland, 2007; Martin et ah, 2008). This section distinguishes 
intersubjectivity from interaction and suggests why additional research was needed to 
understand how elements of instructional design can influence intersubjectivity. 

Defining Intersubjectivity 

Intersubjectivity is the representation of knowledge construction achieved through 
a synergistic progression from individual contributions to sequences of interdependent 
contributions. This definition was built from multiple descriptions provided in the 
literature of a variety of disciplines. 

As a construct with its roots in multiple disciplines, intersubjectivity is described 
in multiple ways with discipline-specific connotations. Three disciplines from which 
intersubjectivity arose are philosophy, psychology, and sociology. From the 
phenomenological branch of philosophy (Husserl, 1931), intersubjectivity represents an 
interactional achievement between independent subjectivities, meaning people or 
personal experiences. As this concept expanded from philosophy to psychology, 
intersubjectivity became a theory of relationship between the psychoanalyst and the client 
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(Fisek, 2010; Natterson, 1993). As it shifted into sociology, intersubjectivity was 
recognized less as a static intersection of the personal experiences of individuals and 
more as the -dynamic interplay between two participating subjective systems” 
(McMahon, 1999, p. 313). 

The emphasis on participation is important to the construct of intersubjectivity 
used in this study. Successful knowledge construction requires — otive and broad 
participation” (Sing & Khine, 2006, p. 254) that occurs at a higher level than surface 
interaction, as noted by Dennen and Wieland (2007). According to Matusov (1996), who 
noted the difference between individual action and this higher level of participatory 
contribution” (p. 27), intersubjectivity represents how individual contributions are 
coordinated with each other during the activity, thereby creating -continuity in activity 
progression” through -building on each other's contributions” (p. 41). Matusov‘s 
description of intersubjectivity is consistent with the description of Baker, Hansen, 

Joiner, and Traum (1998) as the -coordination of contributions in joint activity... not just 
overlapping of conceptualizations” (p.4). Similarly, Garrison, Anderson, and Archer 
(2001) noted that interaction must be -coordinated and synergistic” (p. 21). From these 
descriptions can be ascertained that intersubjectivity involves participation that is 
coordinated and that progresses toward the goal of the activity. 

These descriptions of intersubjectivity are reflected by other researchers, as well. 
These additional reflections bring the discussion closer to the construct of 
intersubjectivity used in this study. For Bober and Dennen (2001), intersubjectivity is the 
development of shared understanding that relates one situation to another, relying on 
artifacts created by the ongoing conversation to develop new contributions to the 
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discourse. The point that intersubjeetivity involves relationship and relianee on artifaets 
is consistent with Suthers (2006), who ealled intersubjeetivity the "sequences of 
dependeneies based on the theoretieal phenomena of interest, sueh as argumentation or 
eollaborative knowledge eonstruetion" (p. 3). The idea of building something new, of the 
eonstruetion of knowledge, is refleeted by Ligorio, Cesareni, and Schwartz (2008) in 
their eoneeption of intersubjeetivity as new understanding resulting from the combination 
of different perspeetives. Similarly, Martin, Sokol, and Elfers (2008) asserted that "it is 
through partieipating within, taking, and eoordinating perspectives, first in interaetions 
and then in intersubjeetive engagements, with others that we beeome ... eommunal agents 
eapable of operating within a diversity of perspectival systems" (p. 314). Just as Ligorio 
et al. separate the proeess of eombining perspectives from the result of understanding, 
and as Martin et al. separate interactive and intersubjeetive engagements, Reieh (2010) 
distinguishes ^roeesses of knowledge-sharing from their empirieal result (whieh may 
range from full intersubjeetivity to utter misunderstanding)” (p. 41). Likewise, Wells 
(1999), stated that "diseourse is a means, not an end in itself, and verbal information is 
valued ... for its use as a means towards the aehievement of some larger purposes" (p. 
231). These refleetions build on the notion of intersubjeetivity as partieipation that is 
eoordinated and progresses toward the goal of the aetivity. These refleetions add the idea 
that partieipation involves learner interdependency, rather than learner independenee, and 
that the goal is knowledge eonstruetion. Thus, the definition of intersubjeetivity is the 
representation of knowledge eonstruetion aehieved through a synergistie progression 
from individual eontributions to sequenees of interdependent eontributions. 
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Distinguishing Intersubjectivity 

In addition to defining intersubjectivity, understanding this study requires 
distinguishing intersubjectivity from interaction. As Jerolmack (2009) pointed out, 
interaction does not require the shared understandings or intentions implicit in 
intersubjectivity. Furthermore, some interactions create barriers to knowledge 
construction (Matzat, 2010). 

Interaction can be defined in many ways. One definition, offered by Wagner 
(1994), is -the reciprocal events that require at least two objects and two actions” (p.8). 
This definition, however, is too broad, as it lacks recognition of people (versus objects) 
and technology. Recognizing the vast expansion of computer-mediated interaction, 
Muirhead and Juwah (2004) described interaction as — adialogue or discourse or event 
between two or more participants and objects which occurs synchronously and/or 
asynchronously mediated by response or feedback and interfaced by technology” (p.l3). 
While this definition acknowledges people and technology, the definition is cumbersome 
and lacks explicit relevance to knowledge construction. 

For this discussion focused on discourse as an indicator of collaborative 
knowledge construction in course-based, online learning, a useful definition is that of 
Gunawardena, Lowe, and Anderson (1997): interaction is the process through which 
negotiation of meaning and the co-creation of knowledge occurs” (p. 407). Although the 
definitions provided by Wagner (1994) and Muirhead and Juwah (2004) describe 
interaction, these definitions do not describe the outcome of the actions beyond their 
occurrence. Another reason why the Gunawardena et al. definition is valid for a 
discussion about course-based discourse is the increasing use of the Interaction Analysis 
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Model from which the definition is drawn (Hall, 2010a). The idea of interaction as a 
process is a key point in distinguishing interaction from intersubjectivity. 

Two Metaphors 

Two metaphors may be useful in distinguishing the concepts of interaction and 
intersubjectivity (Hall, 2010b). The first metaphor is that of a puzzle. Interaction 
represents contributions that exist independently, like solitary puzzle pieces, or 
contributions that occasionally make connections with other contributions, like a few 
pieces that have been connected on the edges of the puzzle. Intersubjectivity, however, is 
the completed puzzle in which each piece, or contribution, connects and contributes to 
the greater whole. 

The second is one of a traveling car, a metaphor that is consistent with the idea of 
an educational journey. In this case, interaction is the car and intersubjectivity is the 
destination. That is, the car is the method, or process, that is used to get to the 
destination, or end-product. If the car is interaction, and the destination is 
intersubjectivity, then the road is the discussion board, which serves as the medium for 
both the process - interaction - and the product - intersubjectivity. As a process medium, 
the discussion board is the work space in which perspectives are exchanged and 
negotiated through interaction. As an outcome medium, the discussion board provides 
the evidence that intersubjectivity has been achieved (Hall, 2010b). 

Hypothetical Example 

An example is useful in understanding the difference between interaction and 
intersubjectivity. In the following excerpt from a hypothetical threaded discussion in a 
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course on human services (Hall, 2010b), two students are diseussing a case study from 
their text: 

Lucas: I think some people make the service delivery proeess too complicated. I 
don‘t know if it‘s the administrators or the practitioners themselves, but aetion is 
often slow and opportunities are missed. 

Takiyah: The deeision-making proeess for a human services praetitioner is very 
difficult. There are so many different players and contexts. It‘s hard to know what 
to do and in what order to do it. I am not sure there is enough guidance on who to 
help first. 

Lucas: The human services practitioner must put the ehild‘s needs above 
everyone else‘s needs. The adults in the situation can take eare of themselves, or 
are at least more responsible for their actions than a child can be. 

This dialogue certainly fits within the definitions of interaction provided above. 

The participants have demonstrated interaction, but not intersubjectivity. While the 

participants have exchanged views, they have neither negotiated nor constructed anything 

new from their eontributions. By interacting at a higher level, intersubjeetivity ean be 

reaehed. Consider the difference when the following when the following exeerpt is 

added to the discussion above: 

Takiyah: While the child‘s needs are certainly very important, I am not sure that 
their needs are always the most important or the first priority. Consider 
Bronfenbrenner‘s eeological systems theory. If we look at the situation from this 
theory, then everybody's needs affeet everybody else. If the parents' needs aren't 
met, then that affects their ability to provide the ehild's needs. 

Lucas: That's a good point, Takiyah. I can see how there are needs of the 
individuals and of the family as a whole. If we look at the case study through this 
theory, then delivery proeess should look not at just one individual at first, but the 
whole family. We should look at the whole community, really, since there are 
many systems whieh affeet this particular family. 

Again, this excerpt certainly represents an interaction. As in the excerpt above, 
the participants are exehanging views. This second exchange, however, demonstrates 


30 



negotiation of meanings (needs of individuals and needs of the family) and construction 
of new knowledge (practitioners should look at the entire system, beyond the family or a 
single individual). A return to the descriptions of intersubjectivity will illuminate this 
point. 

Several descriptions of intersubjectivity have been drawn from the literature. 
Matusov (1996) noted that intersubjectivity requires -continuity in activity progression” 
through -building on each other's contributions” (p. 41). Such continuity and building is 
evident in the second discussion in several ways. Takiyah acknowledges the previous 
contribution of Lucas that the child‘s needs are important then suggests an alternative 
perspective. Lucas then begins his message by acknowledging Takiyah‘s point about 
ecological theory and then continues his message by extending this theory to the 
remainder of the case study under discussion. 

The description of intersubjectivity offered by Baker et al. (1998) is also reflected 
in this second exchange. While the first exchange demonstrates an -overlapping of 
conceptualizations” (p. 4) of the service delivery process, the second exchange 
demonstrates the -coordination of contributions in joint activity” (p. 4). Each learner 
coordinates his or her contributions to the discussion by beginning from the position at 
which the previous learner concluded. Furthermore, both learners coordinated their 
responses using a theory explored in the course material as an anchor for their assertions. 

According to Bober and Dennen (2001), intersubjectivity is the development of 
shared understanding that relates one situation to another and relies on artifacts created 
by the ongoing conversation to develop new contributions to the discourse. In the second 
exchange, Takiyah and Lucas do develop a shared understanding of the complexity of the 
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service delivery process and the possible application of ecological theory to this process. 
In addition, each learner relies upon the previous message as an artifact which is 
referenced in the continuing conversation. This demonstrates the -sequences of 
dependencies” later described by Suthers (2006, p. 4). 

The second exchange between Takiyah and Lucas also reflects Ligorio et al.‘s 
(2008) conception of intersubjectivity as new understanding resulting from the 
combination of different perspectives. Both learners demonstrate a new understanding of 
the service delivery process as seen through material presented within the course. Their 
discussion involved the coordination of perspectives asserted by Takiyah, Lucas, and 
ecological theory. Like Ligorio et ah, Martin et al. (2008) asserted that such coordination 
transforms the learners into "communal agents capable of operating within a diversity of 
perspectival systems" (p. 314). 

With an understanding of intersubjectivity and its difference from interaction, 
attention can be turned to the influence that instructional design has on intersubjectivity, 
specifically the influence of design on the threaded discussion. 

Influence of Design 

Many elements of design can influence any instructional material, with many 
more design elements to consider when the instruction is delivered asynchronously 
online, such as the course this study examined. Two elements of design that are 
particularly important for online courses are the instructional design and the interface 
design. Although Ligorio et al. (2008) noted that tools are part of -the architecture 
sustaining intersubjectivity" (p. 352), Sims (1997) previously summarized the popular 
viewpoint that -quality in an instructional resource is a function of the design effort, not 


32 



the technology” (p.l58). While this assertion is reminiscent of the great debate on media 
and methods by Clark (1983, 1994, 2001), Kozma (1994a, 1994b, 2000), and others, the 
point is particularly valid for the purposes of this study, which focused on how course 
design, not course technology, influenced the quality of interaction such that 
intersubjectivity is demonstrated. Indeed, Woo and Reeves (2007) noted that -design 
guidelines for interaction in online learning are more akin to heuristics than to research- 
based principles” (p. 16) and Niemczyk (2010) continued to call for additional -ways for 
supporting student construction of meaning in ill-structured learning environments” 
(Future Research, para. 1). In the next section, one of these instructional design elements 
- cognitive requirement of prompt (CROP) - is reviewed. 

Cognitive Requirement of Prompt (CROP) 

The first research question of the study asked about the association between 
intersubjectivity and cognitive requirement of prompt (CROP) within the discussion 
threads of online course rooms. The published literature has focused mostly on the 
moderation of online discussions, rather than the design of the prompts that initiate those 
discussions, as an instructional element that can promote higher-order thinking. Since 
Renaud and Murray (2007) concluded that there is an overlap between critical thinking 
and the higher order thinking exemplified in Bloom‘s taxonomy, research using either 
term is accepted as relating to intersubjectivity. 

While Elder and Paul (1998) noted that thinking is driven by questions, not 
answers, Oliver (2008) pointed out that ^te success of the activity can then be judged 
according to responses in the form of answers” (p. 2). It was asserted in this study that 


33 



intersubjectivity within discussion responses represents that success. This section 
explores existing research on the use of questions to promote intersubjectivity and 
examines the need for additional research on the connection. 

Moderating Questions 

As noted previously, the published literature related to questioning has focused 
more on questions posed by either instructors or peers within the dialogue than on the 
original questions or prompts that are written as part of the course design. The role of 
questions has been explored within the contexts of Socratic questioning and scaffolding 
within discussion moderation. 

Socratic questioning. The use of Socratic questioning in discussion moderation 
is one way that cognitive requirement of prompt (CROP) has been explored in the 
literature. The Socratic method of questioning is called such because of the way in which 
Socrates encouraged the critical thinking and reflection of his student, Gaulcon, who 
eventually succeeded in constructing a new understanding of the topic (justice). The 
process of Socratic questioning involves assisting learners in developing their thinking 
and making that thinking explicit. Socratic questioning includes six categories (Paul, 
1993): questions of clarification; questions that probe assumptions; questions that probe 
reasons and evidence; questions about viewpoints or perspectives; questions that probe 
implications and consequences; and questions about the question. 

There is certainly a resemblance in the six categories of Socratic questioning and 
the six levels of Bloom‘s revised taxonomy (Anderson & Krathworthl, 2001) for the 
cognitive domain, which are remember, understand, apply, analyze, evaluate, and create. 
Thus, even though the studies related to the use of Socratic questioning focus on the 
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moderation of discussions rather than the design of discussion questions, the results of 
these studies have implications about the application of Bloom's taxonomy to CROP. 

Although Boulter (2010) did not find a significant relationship between instructor- 
facilitated Socratic questioning and either frequency of participation or critical thinking 
skills, previous studies have found such a relationship. In a review of studies specifically 
focused on online teaching strategies, Yang, Newby, and Bill (2005) reported that the use 
of this questioning technique increased students' level of critical inquiry. These results 
were confirmed in a later study (Yang, 2008), which confirmed that use of Socratic 
questioning in online discussions has shown improvement in learner's critical thinking 
skills. These results influenced the current study by suggesting that initial discussion 
questions assessed using Bloom's revised taxonomy (Anderson & Krathworthl, 2001) 
could generate higher levels of critical thinking, or intersubjectivity, similar to the levels 
found in discussions posts responding to Socratic questioning. Socratic questioning can 
be considered as a specific scaffolding tool for the development and use of critical 
thinking skills in online discussions. 

Scaffolding. The term scaffolding was introduced by Ausubel and Fitzgerald 
(1962) in their discussion of advance organizers. Using the metaphor of an anchoring 
post, Ausubel and Fitzgerald asserted that Adeational scaffolding” (p. 244) that is clear 
and well organized serves as an anchor within a learner's cognitive structures that allows 
for meaningful learning and retention of new concepts. Rogoff and Wertsch (1984) 
related the concept of scaffolding with Vygotsky's (1978) conception of the zone of 
proximal development. Similarly, Sharma and Hannafin (2007) asserted that scaffolding 
-operationalizes Vygotsky's relationship between instruction and psychological 
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development” (p. 28). As noted previously, the eurrent study is rooted in social 
constructionism, another derivative of Vygotsky's social development theory. Thus, the 
concept of scaffolding offers some insight into the present study of the relationship 
between cognitive requirement of prompt (CROP) and intersubjectivity. 

Consistent with the concepts of Ausubel and Fitzgerald's (1962) ideational 
scaffolding and Vygotsky's (1978) zone of proximal development, scaffolding includes 
the prompts used to initiate discussion in online course rooms. Teacher questioning in 
any form has been well-established as a form of scaffolding in the traditional, physical 
classroom (McLoughlin, 2002). As Rosenshine and Meister (1992) demonstrated nearly 
two decades ago, different types of prompts elicit different responses and may lead to 
different learning effects. Thus, different types of prompts should be designed to focus 
on different processes. More recent research shows similar findings that higher-level 
discussion prompts stimulate higher cognitive processes. Cho and Jonassen (2002) found 
that online argumentation scaffolds support students' problem-solving activities, and Tu 
and Corry (2003) concluded that 80-85% of learning is retained when acquired through 
higher- level discussion prompts. Jorgensen (2009) called for additional research -to 
identify how to improve the cognitive level achieved in learner initial discussions” (p. 
118). In terms of this inquiry, the matter becomes the relationship between prompts 
classified according to the different levels of Bloom's revised taxonomy (Anderson et ah, 
2001) expected in the response and the level of intersubjectivity developed in those 
responses. 

Most of the scaffolding provided within online discussions is dynamic, as the 
scaffolding is provided within the context of an ongoing dialogue. Initial prompts written 
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as part of the course design, however, are static. Saye and Brush (2002) called these 
types of scaffolds soft and hard, respectively. Both hard and soft scaffolding are needed 
for effective questioning, as suggested by Ge and Land (2002) and Sharma and Hannafin 
(2007). While soft scaffolds refer to those supports provided by instructors and peers, 
hard scaffolds refer to "static supports that can be anticipated and planned in advance" 
(Saye & Brush, p. 81). Since they are written during course design, initial prompts are 
consistent with the definition of hard scaffolds. 

Initial Prompts 

While the use of questions to promote the kind of critical thinking required for 
intersubjectivity to develop is well established in the literature (see Yang, 2008), there is 
less research on initial questions or prompts. Wang‘s (2005) definition of questioning as 
an instructional device in directing student thinking through productive discussion” (p. 
304) is particularly useful to a discussion of initial discussion prompts. Beaudin (1999) 
found that the most effective way to keep online discussions on topic was to carefully 
design the original questions used to prompt the discussion. More recently, Cheung, 

Hew, and Ng (2008) and Lee (2009) noted that those discussion topics which students 
find interesting and relevant have a greater influence on participation. In a related 
conclusion, Donnelly (2010) suggested that the multitude of low-level messages might be 
a result of the design of the discussion forum and the questions that are posed to stimulate 
discussion. Chin (2004) and Wang (2005) agreed that carefully designed questions are 
required tools for cognitively engaging students. In fact, Wang asserted that the ^vel of 
student thinking is directly proportional to the level of questions asked” (p. 310) and that 
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knowledge construction occurs through responding to high-level questions. This study 
contributed evidence as to the veracity of this assertion. 

Although previous to this study cognitive requirement of prompt (CROP) was 
explored more as a part of the course design, rather than peer or instructor facilitation, 
there was a call for such an inquiry. Without the purposeful design of initial discussion 
questions, Oliver and McLoughlin‘s (2001) observation that online discussions produce 
volumes of unproductive communication” (p. 156) might continue. A decade ago, Kara, 
Bonk, and Angeli (2000) noted the need for pedagogy that encouraged online learners to 
engage in discussions beyond the minimum requirements. Similarly, Halpern (2003) 
argued for the redesign of curricula to incorporate higher-order learning objectives for the 
purpose of improving the critical thinking abilities of students. The instructional design 
elements that guide asynchronous, online discussions were studied by Gilbert and 
Dabbagh (2005), who concluded that additional research was needed on the influence of 
the discussion question on meaningful discourse. In a recent review on critical thinking 
in online environments, Shedletsky (2010) wondered if the lack of critical discourse in 
asynchronous tools is a function of some pervasive influence. Other work continued this 
call for an instructional antidote” (Top9u, 2008, p. 902) to insufficient evidence of 
knowledge construction in online learning. Such an antidote could be informed by the 
results of this study, which focused on the kinds of questions asked at the beginning of a 
discussion thread. Similarly, Hopkins, Gibson, Ros i Sole, Savvides, and Starkey (2008) 
concluded that there was still a great need to focus on those factors that encouraged 
specific forms of interaction among learners. This study addressed these calls for 
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additional research related to higher levels of thought required by original discussion 
questions. 

Although two studies (Bradley et ah, 2008; Christopher et ah, 2004) were 
identified that examine cognitive requirement of prompt (CROP) and online discussions, 
these studies could not fill the gap in the literature related to how initial question design 
influences course room discourse. These studies are considered at length because of their 
relevance to the research undertaken in this study. 

Christopher et al. (2004) examined the levels of thought in question prompts and 
student responses, and any changes over time, among 10 graduate students participating 
in a hybrid course on gifted education. Bloom's taxonomy (Bloom & Krathwohl, 1956) 
was applied to both the questions and the responses in this study. The researchers found 
no pattern of change in the level of thinking that occurred over the course of the semester. 
Similarly, the results indicated no relationship between the level of thinking required in 
the question prompt and the level of thinking demonstrated in the response. In addition, 
Christopher et al. noted that the students stayed within their customary range (low, 
moderate, or high) of critical thinking despite any difference in question prompt. Thus, 
the researchers considered that individual factors might account more for the level of 
critical thinking than did the discussion prompt. 

In their research using three hybrid sections of an undergraduate child 
development course across two semesters, Bradley et al. (2008) used Bloom's taxonomy 
(Bloom & Krathwohl, 1956) to code the responses to questions designed in accordance 
with six types of questions investigated by Andrews (1980). The level of higher-order 
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thinking achieved in a response was one of three dependent variables, along with word 
count and degree of answer eompletion. 

Overall, the researehers (Bradley et ah, 2008) eoneluded that students engaged 
primarily in lower-order thinking across all six question types. The question types that 
resulted in higher levels of thinking were course link, brainstorm, and direet link. Course 
link questions required the integration of a course concept with a topic from an assigned 
^K)t topic” article. Students often used prior knowledge and outside resources when 
answering these questions. Brainstorm questions solicited all possible solutions to an 
identified issue, while direct link questions targeted a specifie portion of the assigned 
artiele and asked students to interpret or analyze this particular section. In answering 
both of these question types, students tended to drawn upon prior knowledge and 
personally relevant examples from their professional contexts. The other three types of 
questions (limited foeal, open focal, and application) did not require students to make 
inferences in their answers. Drawing inferences within an answer would likely involve 
analysis, synthesis, or evaluation, consistent with the higher levels of Bloom's original 
taxonomy (Bloom & Krathwohl, 1956). 

Several elear differenees are present between the Bradley et al. (2008) study and 
the researeh undertaken in this study. One difference was the population and context of 
the studies. Bradley et al. used hybrid courses from a single diseipline (ehild 
development) at the undergraduate level, while the current study focused solely on online 
courses. Another difference between the studies was the way in whieh Bloom's 
taxonomy was applied. The original taxonomy was used in the Bradley et al. (2008) 
study while Bloom's revised taxonomy (Anderson et al., 2001) was used in the current 
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study. In addition, the taxonomy was applied to the answers in the Bradley et al. study, 
whereas the taxonomy was applied to the prompts in the current study. A brief 
exploration of Bloom‘s revised taxonomy is conducted in order to justify its use in the 
current study. 

Bloom’s revised taxonomy, Bloom‘s revised taxonomy (Anderson et ah, 2001), 
as illustrated in Figure 2, can be envisioned as a pyramid in which the lower half refers to 
lower-order cognitive processes (remembering, understanding, and applying) and the top 
half refers to higher-order cognitive processes (analyzing, evaluating, and creating). 


Higher-Order Cognitive Processes 



Lo wer-Order Cognitive Proces ses 

Applying 
Understanding 
Remembering 


Figure 2. Higher- and lower-order cognitive processes associated with Bloom's revised 
taxonomy. 
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There are many philosophical approaches to knowledge and many ways to 

categorize knowledge. The knowledge dimension of Bloom's taxonomy admittedly 

presents just one classification. As Anderson et al. (2001) noted, 

Given the many different terms and the lack of agreement about the many aspects 
of the knowledge dimension, it is a difficult task to develop a taxonomy of 
knowledge that captures the complexity and comprehensiveness of our knowledge 
base while being relatively simple, practical, and easy to use, as well as maintain 
some parsimony in the number of categories, (p. 41) 

The knowledge dimension of Bloom's taxonomy does not distinguish levels of 
knowledge, in the sense of levels being higher or lower than other levels. Rather, the 
taxonomy distinguishes categories of knowledge. The categories simply are different 
without reference to relative depths of knowledge. Unlike the knowledge dimension, the 
cognitive process dimension does address levels that are relative to one another as 
indicators of cognitive depth. Consider, for example, the cognitive processing differences 
between remembering and creating. Thus, the cognitive process dimension offers a scale 
on which prompts can be coded. 

The literature supports the use of Bloom‘s revised taxonomy (Anderson et ah, 
2001) in exploring initial question design, including its use to evaluate e-learning. 
Although somewhat obvious, Athanassiou, McNett, and Harvey (2003) concluded that 
there was a growing awareness in the usefulness of the taxonomy among university 
educators involved in curriculum design. That same year, Chyung and Stepich (2003) 
noted the utility of Bloom's taxonomy as a guide in critical component of instructional 
design - developing congruence between the objectives, activities, and outcomes of a 
graduate-level, online course. 
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Malawi, McCarthy, and Pires (2009) used the revised taxonomy to study the 
relationship between individual factors, instructional factors, and learning outeomes 
through one particular online platform. While the results of their study suggested that 
individual and instruetional faetors do not play a major role in the learning proeess, the 
study and its findings were limited in several aspeets. 

The study is limited by its small size and narrow generalizability. The small 
sample (n=51) was drawn from students in only one management information eourse at a 
single university. Thus, results of the study ean be generalized to only similar students in 
a similar eourse at a similar university in a similar region. This is an important faetor 
eonsidering the data eolleetion instrument foeused solely on the students' opinions, rather 
than an objeetive measure of performanee. 

The operational definition of the variable instructional factors (Malawi, McCarthy, 
& Pires, 2009, p. 376) is another problem for the study. Instruetional faetors were 
eonsidered the effeetiveness of the tools used, interaction with the professor, and ease of 
use of teehnology, two of whieh were dropped during faetor analysis. These elements 
laek neeessary breadth to represent a variable as diverse as instructional factors.” Also, 
as stated previously, only opinions were used to measure these eonstruets, rather than 
using more objeetive measures of performance like transeript analysis. 

The data eolleetion instrument in the Malawi et al. (2009) study eonsisted of a 
survey developed by eombining two previous questionnaires whieh did not use Bloom's 
taxonomy as their basis. Thus, the adapted instrument used eould have had unreeognized 
issues with validity or reliability. The foeus on the opinions of the students means that 
only pereeptions of outeomes, rather than aetual outeomes, were studied. In addition, the 
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adapted instrument asked only 22 questions, nine of whieh were demographic in nature 
related to the variable of individual factors. Only one of the questions related to the 
instructional factors” variable addressed course discussions, and this one question 
combined the participants' opinions on course discussions with the private email and 
calendar functions of the platform. Thus, this study (Malawi, McCarthy, & Fires, 2009) 
does not consider how Bloom's taxonomy is applied to discussion questions used to 
generate course room dialogue. 

These studies (Athanassiou, McNett, & Harvey, 2003; Chyung & Stepich, 2003; 
Malawi, McCarthy, & Fires, 2009) did support the use of the taxonomy in the research 
conducted in this study. The need for such a study was reiterated by Jorgensen (2009), 
who recommended that -additional research be carried out to determine if discussion 
questions written at a higher cognitive level according to Bloom's Taxonomy could 
impact the cognitive level of responses posted” (p. 122). 

In this section, research was reviewed on the influence of questions on the kinds 
of critical thinking and higher order thinking skills required for the development of 
intersubjectivity. While much of the research has focused on the use of moderating 
questions, such as the Socratic Method, as forms of instructional scaffolds, there was 
some research on initial question design. This research called for additional examination 
of the use of questions on cognitive development, similar to that conducted by the current 
study on the influence of cognitive requirement of prompt (CROF) and intersubjectivity. 
In addition, the use of Bloom's revised taxonomy (Anderson & Krathworthl, 2001) was 
justified using several sources from the literature. The next section reviews time in 
course (TIC) as the third variable in this study. 
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Time in Course (TIC) 


The second research question asked about the association between 
intersubjectivity and time in course (TIC) within the discussion threads of online course 
rooms. TIC referred to the calculated percentage of time that had elapsed since the 
beginning of the course. There is a distinct difference that should be noted between the 
concepts of course length and TIC. The former concept considers only two points within 
the term of the course, those being the beginning and the end, while the latter concept 
considers multiple points of time throughout the term. Although a study was not 
identified in which TIC was related to intersubjectivity, time has been explored in several 
other ways within past literature. These ways include comparing traditional and 
accelerated courses, day of posting and thread growth, time delay between postings, and 
changes from the beginning to the end of the course. 

One way in which time has been studied is through comparisons of courses 
offered during traditional and accelerated terms. Anastasi (2007) found that academic 
performance and course evaluations were consistent between courses offered in 
traditional and accelerated terms. These findings are similar to previous results described 
by Kretovics, Crowe, and Hyun (2005), Seaman (2004), and Daniel (2000). Similarly, 
Kucsera and Timmaro (2010) and Poellnitz (2008) found that instructors' effectiveness 
was equivalent between traditional and accelerated courses. Since academic performance 
or instructors' effectiveness are consistent among a variety of course lengths, the length 
of the course in this study did not present a confounding variable. 

Another way that time has been explored is through its relationship with 
opportunities for participation. In an analysis of several studies of online participation. 
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Cheung, Hew, and Ng (2008) identified the availability of time as a faetor that influenees 
partieipation. Sinee students can continue conversations at any time, including after the 
primary discussion timeframe has passed, they can use this additional time to reflect or to 
ask questions. Many students in Meyer ‘s (2003) study expressed appreciation for the 
equitable nature of online discussions, in that each student had the opportunity to express 
himself. This democratic sentiment is similar to the justification of discussion-based 
teaching asserted by Brookfield and Preskill (2008). Among other factors, a physical 
classroom and scheduled class time can inhibit equitable discussion. Previously, Meyer 
had noted that online discussions expand the amount of time that is spent on course 
objectives. 

Time has also been explored by examining the relationship between when 
messages are posted and thread growth. Jeong and Frazier (2008) examined how the day 
in which messages are posted (early, midweek and weekend) and found that the day of 
posting had a significant effect on the number of responses elicited per message. The 
later in the week an initial message was posted, the fewer the number of peer responses 
posted to that message. This finding seems intuitive, as there is less time to respond 
before the close of unit at the end of the course week. However, Hewitt (2005) had 
previously noted that thread growth is stunted by attending to new posts and ignoring 
older posts. The finding that learners pay more attention and respond to the recent 
messages, rather than to the previous messages, would suggest that more responses would 
occur toward the end of the week, as learners attempt to comply with course expectations 
related to the number of peer responses per unit. 
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A fourth way in which time has been explored within the literature, related to 
course room interaction, is the time between initial posting and response. Although 
Garrison, Anderson, and Areher (2000) suggested that more time for critical reflection 
and to formulate a coherent, written argument is needed for intersubjeetivity to develop in 
online discourse, other researehers have suggested that limiting time frames for 
discussion threads and the replies within these discussion threads would improve 
interaetivity and social presence. Tu (2002) suggested defining an appropriate response 
time, such as within 72 hours, while Pendergast (2006) suggested limiting the time frame 
for the entire diseussion, sueh as loeking a discussion at the end of the unit. However, 
later research by Huntley and Thatcher (2008) eoncluded that time delay between 
discussion posts was not related to the knowledge construction that occurred within either 
the content of the individual discussion postings or the highest level of knowledge 
construction achieved within an entire discussion thread. 

Two studies have contributed to the understanding of student responses and 
course length, though not time in eourse (TIC). Christopher et al. (2004) examined the 
levels of thought in question prompts and student responses, and any ehanges over time, 
among 10 graduate students participating in a hybrid course on gifted edueation. The 
researchers found no pattern of change in the level of thinking that occurred over the 
course of the semester. Although Boulter‘s (2010) study was not speeifically about 
interaction and course length, she did note a small but significant indication that the depth 
of eritical thinking exhibited within diseussions inereased toward the end of an 1 1 -week 
eourse in both the treatment and control groups, using Socratic questioning as an 
intervention. 
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Now that each variable has been reviewed, the selected instrument for measuring 
the outcome variable, intersubjectivity, is examined. 

Interaction Analysis Model (lAM) 

Both research questions in the research conducted in this study related a particular 
characteristic of threaded discussions (cognitive requirement of prompt or time in course) 
to the construct of intersubjectivity. The instrument selected to measure intersubjectivity 
within the discussion threads of the online course rooms is the Interaction Analysis 
Model (lAM) developed by Gunawardena et al. (1997) and presented in Appendix A. 

This model, part of the broader category of content analysis, is one of the most frequently 
used tools for identifying the levels of knowledge construction within computer-mediated 
communication (Hall, 2010a). The framework of content analysis and the development 
of the lAM are discussed in this section, while the validity of the lAM is presented in 
Chapter 3. 

Content Analysis 

The lAM is one tool in the larger toolbox known as content analysis. As a broad 
term, content analysis represents various kinds of textual analyses that compare, contrast, 
and categorize data (Neuendorf, 2002). Although not called content analysis at the time, 
the Catholic Church demonstrated the first known application of content analysis in the 
late 1600s when it conducted a systematic examination of early newspapers in order to 
track the proportion of printed texts which were nonreligious (Krippendorff, 1980). 

The actual term -eontent analysis” first appeared in a book written in 1940 by 
Waples, Berelson, and Bradshaw (Hopkins, 2010). The authors of the book originally 
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defined content analysis as the -e-bjective, systematic, quantitative description of the 
manifest content of communication” (Berelson, 1952, p. 519). This focus on the 
quantitative description continued until 1984, when Woodrum (as cited in Clara & Mauri, 
2010) suggested that content analysis was situated between quantitative and qualitative 
approaches because the qualitative aspects of the text are transformed into codes that are 
analyzed with quantitative procedures. In noting the qualitative aspects of context 
analysis, Woodrum opened the door to the well-known qualitative content analysis 
method developed by Henri (1992). Henri‘s method is discussed in the section, 
development of the lAM,” as the basis for the instrument used in this study. The 
middle ground proposed by Woodrum is consistent with the interactive continuum of 
methodologies espoused by Newman and Benz (1998). 

Content analysis has been established as an effective method for analyzing computer- 
mediated communication (Krippendorff & Bock, 2008) and is widely used in the field of 
computer-supported collaborative learning (Strijbos & Stahl, 2007). In terms of 
illuminating the learning process, content analysis can be used to better understand how 
learners present and refine their ideas and collaborate with other learners (Blake & 
Rapanotti, 2001). A key requirement of this now established social science methodology 
(Herring, 2010), according to one of the original authors who coined the term, is that -a-11 
of the relevant content... be analyzed in terms of all of the relevant categories” (Berelson, 
1952, p. 17). In the current study, all of the relevant content includes all of the learner 
posts within the course, and all of the relevant categories include the phases of the lAM 
(Gunawardena et ah, 1997). Thus, the current study accomplishes the key requirement of 
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content methodology by eomparing all learner-to-learner posts with all the eategories of 
the lAM. 

Development of the lAM 

Gunawardena et al. (1997) first reviewed existing interaetion analysis models in 
seareh of one that would be appropriate to analyze the transeript of a eomputer 
eonferenee. The researehers eonsidered several of the models reviewed by Mason 
(1991). These models ineluded the message maps of Levin, Kim, and Riel (1990) whieh 
served as diagrams of eonferenee conversations. The researehers also reviewed the 
model of Henri (1992), whieh evaluated eonferenee eontent related to the soeial and 
interactive dimensions and eognitive and metaeognitive skills. The model of Garrison 
(1992) was examined, too, as this tool measured eritieal thinking in both faee-to-faee and 
eomputer-supported group learning. The researehers also eonsidered the work of 
Newman, Webb, and Coehrane (1995), who suggested that the five stages of Garrison‘s 
eritieal thinking related to the eognitive skills dimension of Henri‘s model. Upon testing 
these models to the transeripts of the eomputer eonferenee, Gunawardena et al. eoneluded 
that the models were insuffieient beeause they foeused on a teaeher-eentered instructional 
paradigm, failed to distinguish between eognitive and metaeognitive dimensions, or 
interpreted interaetion as ^neehanistie and deseriptive” (p. 407). In a later publieation 
(Gunawardena, Lowe, & Anderson, 1998), the researehers suggested that settling for the 
previously identified measures — is to ovdook the unparalleled opportunity to observe 
knowledge eonstruetion in progress offered by transeript analysis” (p. 2). 

Upon identifying the shorteomings of the existing interaetion analysis models, 
Gunwardena et al. (1997) proeeeded to use a grounded theory approaeh to develop their 
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own model, the lAM, whieh is the instrument used in this study. The researehers 
analyzed the transeript looking for four elements: types of cognitive activity performed, 
types of arguments advanced, resources used to explore and negotiate new meanings, and 
evidence of changes in personal knowledge constructions. These four elements were 
used to outline the process of negotiation representative of the social construction of 
knowledge. This process includes the five phases of sharing/comparing, dissonance, 
negotiation/co-construction, testing tentative constructions, and statement/application of 
newly-constructed knowledge. Each of the five phases within this model has three, four, 
or five indicators. The model is illustrated in Appendix A. 

After developing the lAM using the principles of grounded theory, 

Gunawardena, et al. (1997) applied the lAM to the debate transcript. The unit of analysis 
was determined to be a participant's entire, single message because the message 
-embodied a participant's cognitive activity and contribution to the construction of 
knowledge” (p. 416). All five phases of the model were identified within the conference 
transcript, supporting the efficacy of the model for interaction analysis within 
constructivist environments. The validity of the I AM is discussed in Chapter 3. 

Significance to Field of Instructional Design 
As online course delivery continues to grow (Allen & Seaman, 2010), 
instructional designers will have increasing opportunities to design learning activities that 
promote quality course room discourse. Rather than relying on heuristics (Silber, 2007; 
Woo & Reeves, 2007), instructional designers would benefit from the development of 
research-based principles on which to design the prompts that direct the initial course 
room discussions. The purpose of this study was to investigate the relationships between 
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a measure of the quality of interaction in course room discourse, intersubjectivity, and the 
instructional design elements of cognitive requirement of prompt (CROP) and time in 
course (TIC). This study adds research to the knowledge base of instructional design by 
offering information about the relationship between the two elements of instructional 
design (CROP and TIC) and the identified indicator of quality in course room discourse 
(intersubj ectivity) . 


Summary 

Social constructionism, and its roots in constructivism, was examined as the 
theoretical framework for the study. Each of the three variables, which are 
intersubjectivity, CROP, and TIC, was reviewed within the context of the relevant 
literature. While interaction has been explored within the literature, this chapter noted 
the difference between interaction and intersubjectivity and identified significant gaps in 
understanding how elements of instructional design contribute to intersubj ectivity. 
Similarly, while the role of questions and the impact of time have been explored in the 
literature, conclusions are contradictory or only indirectly related to the variables of this 
research. This study fills some of those gaps by examining the relationship between 
intersubjectivity and the design elements of CROP and TIC. The data collection 
instrument (lAM) used to measure intersubjectivity was examined. The results of this 
study assist instructional designers in understanding the influence of these design 
elements on the collaborative construction of knowledge in online courses. In Chapter 3, 
the quantitative methodology and correlational design are discussed. 
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CHAPTERS. METHODOLOGY 


The purpose of the study was to investigate the relationships between 
intersubjeetivity, as a measure of the quality of interaetion in course room discourse, and 
(a) cognitive requirement of prompt (CROP) and (b) time in course (TIC) within the 
threaded discussions of online course rooms. 

The previous chapter explored the existing literature on the theory of social 
constructionism and the influence of discussion prompts and time on the intersubjeetivity 
displayed in threaded discussions. This chapter explains the methodology of the current 
research as it is situated within the literature explored in the previous chapter. The 
philosophical foundations and methodological assumptions of the research design are 
briefly reviewed as they relate to the justification of the selected research method. The 
research questions are posed and the definitions of the variables are reviewed. The 
sampling design is explained, the data collection plan is described, and the data analysis 
plan is introduced. The final topics discussed in this chapter are the strategies employed 
to reduce threats to validity and the ethical issues related to the research conducted. The 
research design is explored first. 


Research Design 

The research design is the link between the research methods and the 
philosophical foundations and methodological assumptions of a particular approach. 

This research employed a quantitative methodology to consider intersubjeetivity, 
cognitive requirement of prompt (CROP), and time in course (TIC) within the discussion 
threads of online course rooms. Creswell (2009) called the different designs within each 
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research method -strategies of inquiry” (p. 11). Quantitative strategies of inquiry include 
experimental and non-experimental designs, distinguished by the ability to directly 
manipulate an independent variable (Vogt, 2007). The current study used a non- 
experimental design because an independent variable was not manipulated; instead, the 
study examined the correlation between the variables and did not examine causation. An 
explanatory correlational design was used to measure the relationships between the 
variables. A brief review of the philosophical foundation and methodological 
assumptions of the quantitative approach support its use in this study. 

Philosophical Foundation 

The philosophical ideas behind any study should be illuminated because of their 
influence on the research (Creswell, 2009). The quantitative approach assumes reality is 
a single, tangible construct that keeps the Aenower” and the Aenown” relatively 
independent (Yu, 2006). This approach seems contradictory to the study ‘s theoretical 
framework of constructivism, which suggests that the Aenower” and the Aenown” are 
inextricably intertwined. Constructivism is usually associated with a qualitative, rather 
than quantitative, methodology. Fortunately, as asserted by Strijbos and Fischer (2007), 
the best approach to address a particular research question may not be the approach most 
compatible with a researcher's particular philosophy or tradition. Instead, researchers 
should note that — itsiboth possible to subscribe to the philosophy of one approach and 
employ the methods of the other” (Gelo, Braakmann, & Benetka, 2008, p. 268). This 
recognition is embraced within the current study in which the researcher subscribes to the 
philosophical foundations of a qualitative approach (social constructionism) while 
appreciating the necessity of a quantitative approach for the research questions posed. 
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Given the adoption of a quantitative methodology, the assumptions associated with that 
methodology can be considered briefly. 

Methodological Assumptions 

Quantitative studies are theory-driven because they start with a new or existing 
theory and then lead to a deduction about whether or not the theory is supported; thus, a 
quantitative study is appropriate when the purpose is to test a theory, thereby explaining, 
predicting, confirming, or validating the idea under study (Leedy & Ormrod, 2005). This 
study began with the theory of social constructionism and used this theory in explaining 
the relationship between three variables. The quantitative approach is nomothetic in that 
it is extensive and generalizing (Lamiell, 1998). With this brief introduction to the 
philosophical foundations and methodological assumptions of the research design, 
attention can now be turned to the particular elements of the method for this research. 
Research Method 

The procedures and techniques involved in data collection, analysis, and 
interpretation, in addition to sampling, comprise the topic of research methods. In this 
section, data collection, including sampling and coding, and data analysis are addressed. 
The development of the instrument to measure intersubjectivity was explored in Chapter 
2, while the validity of that instrument is discussed later in this chapter. As a means of 
review, the research questions and definitions of the variables are offered first. 

Research questions and variables. The purpose of the study was to investigate 
the relationships between intersubjectivity, as a measure of the quality of interaction in 
course room discourse, and (a) cognitive requirement of prompt (CROP) and (b) time in 
course (TIC) within the threaded discussions of online course rooms. 
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Cognitive requirement of prompt (CROP) is the level of thinking that should be 
evident in a response to a diseussion prompt. This definition is supported by Wang‘s 
(2009) assertion that the ^vel of student thinking is directly proportional to the level of 
questions asked” (p. 310) and that higher-order thinking is represented in the top three 
levels of Bloom‘s taxonomy. Similarly, Christopher et al. (2004) also categorized 
discussion prompts according to Bloom's taxonomy. Time in course (TIC) is defined as 
the amount of time that elapsed before a particular message was posted to the discussion 
board and will be measured using percentage of course completion. Intersubjectivity is 
the product of knowledge construction resulting from the coordination of multiple 
perspectives among learners engaged in course room discourse (Hall, 2010b). There were 
two research questions. 

1 . What is the association between intersubjectivity and CROP within the 
threaded discussions of online course rooms? 

2. What is the association between intersubjectivity and TIC within the threaded 
discussions of online course rooms? 

With this review of the research questions and variables, the data collection and analysis 
can be introduced. 


Data Collection 

Data for the research was collected from the archived transcript of one 
undergraduate level, wholly online course at a regionally accredited school. Content 
analysis, which represents various kinds of textual analyses that compare, contrast, and 
categorize data (Neuendorf, 2002), was used to review the transcript of the threaded 
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discussions. The validity of the data collection instrument, the sampling design, and 
coding are diseussed in this seetion. 

Validity of the lAM 

Both research questions in the study related a particular characteristic of threaded 
discussions (cognitive requirement of prompt or time in course) to the construct of 
intersubjectivity. The instrument selected to measure intersubjectivity within the 
discussion threads of the online course rooms was the Interaction Analysis Model (lAM) 
developed by Gunawardena et al. (1997) and presented in Appendix A. The framework 
of content analysis and the development of the lAM were diseussed in Chapter 2. This 
discussion focuses on the validity of the lAM as established in the literature. 

Generally, validity refers to the aceountability and legitimacy that exists in the 
data colleetion, analysis, and interpretation within a study. Messick (1989) noted that 
-v-alidity is an integrative, evaluative judgment of the degree to which theoretical 
rationales and empirieal evidenee support the adequaey and appropriateness of 
interpretations and actions based on test scores or other methods of assessment” (p. 13). 
However, Rourke and Anderson (2004) noted that researehers often fail to provide 
sufficient information to judge the validity of the content analysis protocols utilized in 
published studies. They coneluded that using existing protoeols, rather than ereating new 
ones, added to the aceumulating normative data and overall validity of the existing 
protoeol. The popularity of the lAM has resulted in just such an accumulation. Given 
the critieality of intersubjeetivity in this study, the validity and reliability of this researeh 
is inextricably linked to the validity of the instrument chosen to measure intersubjeetivity. 
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Thus, significant attention is paid to the aeeumulation of data that support the validity and 
reliability of the lAM. 

The lAM has been used more than any other interaetion analysis model in the 
published literature (Hall, 2010a). Studies were identified through the searehes in the 
following databases, the number of results of whieh are reported in parentheses and 
include duplieation: Sage-Educational Collection (3), ProQuest-Education (54), 

Academic Search Premiere (69), AB I/Inform Global (3), ProQuest-Psyehology (10), 
PsyArtieles (0), SAGE-Psychology (3), and Seience Direct College Edition-Soeial & 
Behavioral Seienees (80). 

Several elements of support for the lAM ean be extraeted from this aeeumulation 
of eonsistent data in 40 published studies spanning 13 years. One element of support is 
the growing use of the lAM since its development in 1997, as illustrated in Eigure 2. 



'Number of Studies 


Figure 3. Number of published studies using the lAM between 1997 and June 2010. 
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In the first half of 2010, the lAM has been used in more published studies than in any 
other full year. Consistent and inereasing use of the lAM represents its aeeeptance as a 
valid instrument for the analysis of eourse room transeripts. 

Another element of support for the lAM eomes from the high levels of inter-rater 
reliability among the 22 published studies in whieh the measure is reported. Measures of 
inter-rater agreement, after resolution, in these published studies are summarized in 
Appendix B. An average measure of inter-rater reliability would be invalid because of 
the different methods used to calculate each statistic. In addition, some studies reported 
ranges rather than exact numbers. Noting the high level of inter-rater reliability across 
the multiple uses of the lAM adds validity to the use of the instrument in the current 
study. 

With an understanding of the instrument to be used, attention can now be turned 
to selection of the research site and coding the data. 

Research Site 

There were several requirements of a potential research site. The institution had 
to have regional accreditation, which served as a control measure to ensure a baseline 
level of quality among the chosen institution and its courses. The institution had to offer a 
wholly online course for which an archived transcript was available. In addition, a 
potential research site had to be willing to provide the transcript for research. Such a site 
was suggested during a routine conversation with an academic advisor. 

The school was then contacted to identify the process of research approval 
required. Upon compliance with the institution's protocol and approval of the study by 
Capella University's Institutional Review Board, the transcript of the identified course 
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was obtained by a research assistant who removed all identifying information. The next 
step in the data collection was then coding the data. 

Coding 

The total number of posts was counted and recorded. The posts of the course 
instructor were marked, counted, and recorded. These messages were not coded, as the 
purpose of this study was to investigate knowledge construction among learners. To 
ensure the accuracy of the count, the number of learner posts and the number of instructor 
posts were added and the sum compared to the total number of posts. Next, the transcript 
was coded according to the operational definitions of time in course (TIC), cognitive 
requirement of prompt (CROP), and intersubjectivity. 

Time in course (TIC) was the amount of time that elapsed before a particular 
message was posted to the discussion board and was measured using percentage of 
course completion. This percentage was calculated using a procedure similar to that 
outlined in the Code of Federal Regulations (34CFR668.22(f)(l)(i)) for determining 
period of enrollment for the treatment of Title IV grant or loan funds. Thus, the total 
number of calendar days completed prior to the date on which the message was posted to 
the discussion board was divided by the total number of calendar days of the length of the 
academic term. The result was rounded to the nearest whole number. This method 
allowed for an analysis of TIC after intersubjectivity was measured throughout the 
course. These percentages were marked on the transcript and entered into the data 
collection spreadsheet. 

For example. Message 62 was posted on March 26, which was Day 68 of the 
course. The number of calendar days completed prior to this date was 67, which is 
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divided by the number of ealendar days of the length of the aeademie term (91), resulting 
in a quotient of 0.736. When eonverted to a percent, the result is 73.6% and rounded to 
74%. Thus, the percentage of course completion for Message 62 is 74%. 

The transcript was then segmented according to discussion prompt and coded in 
numerical order beginning with — T These codes were marked on the transcript and 
entered into the data collection spreadsheet. Each prompt was then examined using 
Bloom‘s revised taxonomy (Anderson et ah, 2001). Bloom's taxonomy has been used 
previously to identify the effectiveness of e-leaming across curricula and delivery 
platforms (Christopher et al., 2004; Hawaii, McCarthy, & Fires, 2009). The cognitive 
requirement of prompt (CROP) is the level of thinking that should be evident in a 
response to each discussion prompt and was measured as the highest level of Bloom's 
revised taxonomy required within a response to the prompt. Based on the highest level of 
the taxonomy required in a response, the prompt was coded as follows: remembering (1), 
understanding (2), applying (3), analyzing (4), evaluating (5), or creating (6). These 
codes were marked on the transcript and entered into the data collection spreadsheet. 

The subsequent threads of each discussion question or prompt were then be coded 
for intersubjectivity using the Interaction Analysis Model (lAM) developed by 
Gunawardena et al. (1997). As shown in Appendix A, the lAM has five phases, with 
each phase having three, four, or five indicators. Although the original application of the 
lAM used Roman numerals to indicate phases, this study used Arabic numerals in order 
to facilitate later computer analysis. Consistent with previous studies (Beaudrie, 2000; 
Luebeck & Bice, 2005; Moore & Marra, 2005; Onrubia & Engel, 2005), each post was 
coded according to the highest phase of the lAM present within the response. Thus, a 
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post which demonstrated several indieators of different phases was assigned a single code 
aceording to the highest phase represented in the response. Examples are provided in 
Chapter 4. 

Inter-Rater Reliability 

Inter-rater reliability is an important measure of control within data coding. Data 
in the this study were eoded by a researeh assistant who had coding experience and was 
trained in the application of the lAM and the data collection spreadsheet. 

Inter-rater reliability was caleulated before discussion of those posts with 
inconsistent codes. KrippendorfPs alpha was used because this measure is funetional in 
eontent analysis with any number of ratings, levels of measurement, or size of sample 
(Hayes & Krippendorff, 2007). There is some debate about researehers about the 
minimum quality threshold required, as some discourse-based eontent analysis studies 
have demonstrated reasonable quality with a 0.7 agreement, though some researchers 
have ealled for a threshold as high as 0.9 (Neuendorf, 2002). Generally, a 0.8 level of 
agreement is well supported as a quality standard (Artstein & Poesio, 2005). 

In summary, the data were collected from the archived course transeript using 
codes for time in course (TIC), cognitive requirement of prompt (CROP), and 
intersubjectivity. Once the data were collected and reeorded for each transcript, data 
analysis began. 


Data Analysis 

Analyzing the data refers to examining the results of the colleetion instruments in 
order to address the research question. In this study, the instruments used to collect the 
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data included Bloom‘s revised taxonomy (Anderson & Krathwohl, 2001) and the lAM 
(Gunawardena et al. 1997). The data eollected included eognitive requirements of 
prompt (CROP), time in eourse (TIC), and level of intersubjeetivity in order to answer 
two researeh questions. These two research questions were related to the relationship 
between intersubjeetivity and CROP and the relationship between intersubjeetivity and 
TIC. 

In a quantitative study, the data are analyzed using statistieal proeedures that 
either do or do not provide a determined level of significanee in the relationship between 
the variables (Gorard, 2001). KendalPs tau-e was used to analyze the eategorieal data. 
This ealculation avoids assumptions about frequeney distributions and linearity of 
relationship (Creswell, 2008). Furthermore, the ealeulation makes adjustments for ties in 
the data and is appropriate for reetangular contingeney tables (Agresti, 2010), meaning 
the number of eategories for eaeh variable is unequal. 

While the validity and reliability of the lAM are eritieal to the study and have 
been addressed in this ehapter, there were other threats to validity that were addressed. 

Potential Threats to Validity 

A study‘s validity ean be eompromised in many ways. Vogt (2007) eategorized 
more than 24 kinds of threats into four categories: eonstruct validity, external validity, 
statistieal eonelusion, and internal validity. Eaeh of these eategories is discussed relative 
to ways that these threats were managed during this study. 
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Construct Validity 

Creswell (2008) defined eonstruet validity as — aietermination of the signifieanee, 
meaning, purpose, and use of seores from an instrument” (p. 638). Thus, a threat to 
eonstruet validity would be in the measures with whieh the eonstruet of interest was 
quantified. In this study, the eonstruet of interest was intersubjeetivity and the tool of 
measurement was the lAM. The operational definition of intersubjeetivity has been 
drawn from the literature and the validity of the instrument has been established. 
Therefore, the threats to eonstruet validity were minimal. 

External Validity 

Threats to external validity oecur when inferenees are ineorreetly generalized 
from the sample to the population (Vogt, 2007). Within the eategory of external validity, 
Creswell (2009) identified three types of threats related to selection, setting, and history. 
This study minimized these threats because all of the peer responses were used, rather 
than just a sample of those responses. Since only one online course was studied, 
generalizations were not made to hybrid or on-site courses. Similarly, generalizations 
were not made to learners at different levels or in different domains. 

Internal Validity 

Internal validity is related to the ability to draw causal inferences about the 
participants, treatments, and procedures within a study. Since this study involved a 
correlational, versus causal, design, the threats to internal validity were minimal. 
Conclusions based on the research focused on association rather than causation. 

Statistical Conclusion 
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Another category of threats to validity is that of statistical conclusion. According 
to Vogt (2007), such threats occur as the result of erroneous choices of statistical 
computations when analyzing the data. These choices include using a particular 
statistical technique when the data violate the assumptions of that technique. For 
example, a threat would occur if parametric statistics were used with nominal or 
categorical data that were not normally distributed. Another example would be selecting 
a computation that has low statistical power. To minimize the threats of statistical 
conclusion, Kendall's tau-c was used to analyze because this calculation avoids 
assumptions about frequency distributions and linearity of relationship (Creswell, 2008). 
In addition, inter-rater reliability was calculated and reported. 

A final kind of threat that was considered was the threat to ethical tenets related to 
conducting research that involves records generated by human subjects. 

Ethical Issues 

The need to consider ethical issues exists throughout the design, conduct, and 
conclusion of research. Creswell (2009) identified several issues in these areas, including 
ethical issues in the purpose and questions, data collection, data analysis and 
interpretation, and in writing and disseminating the research. Each of these areas is 
considered below. 

Purpose and Questions 

Another opportunity to consider ethical issues was within the purpose and 
questions of the research. Creswell (2009) identified deception and sponsorship as two 
important elements to consider for this area. In this study, the purpose of the research 
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was thoroughly explained to the administrators at the potential researeh site, meaning the 
school from which a course transcript was obtained. The established procedures were 
followed for approving research at the school, which involved approval through the 
academic dean of the institution. Deception was unnecessary for the intent of this study 
and, thus, was avoided at all stages of the research. The research was not financially 
sponsored by another entity, either individual or institutional, and the name of the school 
participating in the research remains confidential. 

Data Collection 

The data collection phase involves many ethical considerations. The researcher 
had no affiliation with or influence on the course in which the data were collected. The 
study did not involve vulnerable populations and had a very low chance of physical, 
psychological, social, economic, or legal harm. These elements were identified by Sieber 
(1998) as ethical considerations during data collection. Since a transcript without 
identifying information was used in this research, the data were considered historical and 
informed consent forms were not necessary. As described in the data collection section 
on coding, identifying information was removed from the transcript. Electronic 
documents were password protected and printed documents were kept in an enveloped 
marked -eonfidential” and stored in a locked box. 

Another consideration of this phase is the ethical application of the instrument, 
which involves some subjectivity since the construct being measured is latent rather than 
manifest. Since a research assistant was used to establish inter-rater reliability, training 
was conducted and a confidentiality agreement was prepared and signed before data 
collection began. 
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Analysis and Interpretation 

Creswell (2009) identified several ethieal issues that eould have arisen during data 
analysis and interpretation. In addition to using a eourse transeript without identifying 
information about the learners, the identity of the partieipating institution has been kept 
eonfidential, as well. Another eonsideration is ownership of the data, whieh remains with 
the doetoral researeher. Coded data, with no identifiable information about the students, 
faeulty, or institution, will be retained on two digital storage deviees stored at two 
separate loeations for a period of five years, after whieh time the need for eontinued 
aeeess to the data will be reviewed. 

Writing and Dissemination 

The writing and dissemination of the researeh also involves ethieal issues. 
Creswell (2009) identified the need for the researeher to state a eommitment, as is done 
here, that findings were not suppressed, falsified, or invented in order to meet the needs 
of the researeher or any partieular audienee. In addition, the researeher will make 
available all details of design, eolleetion, and analysis for others to use in eonsidering the 
eredibility of the interpretations and eonelusions of this researeh. 

In addition to addressing these ethieal issues, the researeh was reviewed and 
approved by the Institutional Review Board of Capella University and the established 
protoeol at the researeh site. 

Summary 

This study used a non-experimental design beeause an independent variable was 
not manipulated; instead, the study examined the eorrelation between the variables (time 
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in course, cognitive requirement of prompt, and intersubjeetivity) and did not examine 
eausation. An explanatory eorrelational design was used to measure the relationships 
between the variables. Data for the research was collected from the arehived transeript of 
one online communications course at a regionally aecredited school. Convenience 
sampling was appropriate in this study because the sehool had to have an arehived 
transcript available and had to be willing to provide the transeript for the research. 

The transcript was coded for each variable. Time in eourse (TIC) was measured as 
the total number of calendar days completed prior to the date on whieh the message was 
posted to the discussion board divided by the total number of ealendar days of the length 
of the academic term. The cognitive requirement of prompt (CROP) is the level of 
thinking that should be evident in a response to eaeh diseussion prompt and was 
measured as the highest level of Bloom's revised taxonomy required within a response to 
the prompt. The subsequent threads of eaeh discussion prompt were then eoded for 
intersubjeetivity using the Interaetion Analysis Model (lAM) developed by Gunawardena 
et al. (1997) and presented in Appendix A. Support for the lAM comes from its 
increasing use over the last 13 years and the high levels of inter-rater reliability among 
the 22 published studies in which the measure is reported. 

In this study, inter-rater reliability was measured using KrippendorfP s alpha. 

This measure was chosen because of its functionality in content analysis with any number 
of ratings, levels of measurement, or size of sample (Hayes & Krippendorff, 2007). 
Kendall's tau-c was used to analyze the categorieal data. This calculation avoids 
assumptions about frequency distributions and linearity of relationship (Creswell, 2008). 
Furthermore, the calculation makes adjustments for ties in the data and is appropriate for 
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the rectangular contingency tables (Agresti, 2010) of this study, meaning the number of 
categories for each variable was unequal. 

Threats to validity were minimized. Threats to construct validity were minimized 
by using an instrument (lAM) with established validity. The study reduced threats to 
external validity by qualifying generalizations drawn from the study. Threats to 
statistical conclusions were minimized by using a calculation (KendalTs tau-c) that 
avoids assumptions about frequency distributions and linearity of relationships. 

Possible violations of ethical tenets were also avoided in this research. The 
purpose of the research was clear and the significance of the research questions was 
established. The study involved data without identifying information, did not involve 
vulnerable populations, and had a very low chance of physical, psychological, social, 
economic, or legal harm. A research assistant, used for establishing inter-rater reliability, 
was trained in order to ensure ethical application of the instrument (lAM). Research 
findings were not suppressed, falsified, or invented in order to meet the needs of the 
researcher or any particular audience. The data, with no identifiable information about the 
students, faculty, or institution, will be retained on two digital storage devices stored at 
two separate locations for a period of five years, after which time the need for continued 
access to the data will be reviewed. 
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CHAPTER 4, DATA COLLECTION AND ANALYSIS 


Researchers have consistently noted that threaded discussions lack the continuity, 
progression, and dependencies needed to achieve knowledge construction in a 
constructivist learning environment. While interaction is inherent in constructivist 
learning, it is feasible to take interaction to a higher level. Course room discourse among 
learners has consistently lacked this higher level of quality. 

With the content of discussion posts ranging from substantive to irrelevant, the 
problem investigated by this study was the lack of consistent quality in discussion board 
interactions. One way to measure the quality of discussion posts is the level of 
collaborative knowledge construction, or intersubjectivity, achieved within the post. 
Intersubjectivity, as the representation of knowledge construction achieved through a 
synergistic progression from individual contributions to sequences of interdependent 
contributions, represents this higher quality of synthesis among learners engaged in 
course room discourse. 

Many factors influence intersubjectivity within the threaded discussions of online 
courses. This study examined two particular course elements that influence 
intersubjectivity: cognitive requirement of prompt (CROP) and time in course (TIC). 

The purpose of the study was to investigate the relationships between intersubjectivity, as 
a measure of the quality of interaction in course room discourse, and (a) cognitive 
requirement of prompt and (b) time in course within the threaded discussions of an online 
course room. There were two research questions. 
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1 . What is the association between intersubjectivity and cognitive requirement of 
prompt (CROP) within the threaded discussions of online course rooms? 

2. What is the association between intersubjectivity and time in course (TIC) 
within the threaded discussions of online course rooms? 

An explanatory correlational design was used to measure the relationships 
between the variables. Content analysis, specifically the Interaction Analysis Model 
(lAM) of Gunawardena et al. (1997) was used to measure the intersubjectivity of student 
responses posted to the discussion boards. The cognitive requirement of prompt (CROP) 
was determined by the level of cognitive processing, according to Bloom‘s revised 
taxonomy (Anderson et al., 2001), required in a learner's response to the prompt. Time in 
course (TIC) was calculated as the percentage of time that had elapsed between the 
beginning of the course term and the date on which a message was posted. 

This chapter is organized into two main sections: data collection and data 
analysis. The data collection section includes a description of the research site and the 
coding procedures. The data analysis section is divided by the two research questions. 

Data Collection 


Description of Research Site 

The peer responses studied in this research were taken from the archived course 
room discussion posts of an online course in Communication offered during Spring 2010 
at a regionally accredited community college in the Midwestern region of the United 
States of America. Although the transcripts of the threaded discussions had identifying 
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information removed prior to data eollection and analysis, anonymous demographic 
information was available about the student population of the college. 

Institutional demographics. According to a profile provided by the institution, 
there were 4,515 students enrolled at the institution during Spring 2010 with an average 
load of 10.4 hours per academic term. The gender distribution of students was 58% 
female and 42% male. Likewise, the age of the student population was nearly equally 
divided between traditional students (Age 24 and younger) and non-traditional students 
(Age 25 and older) with 59% and 41%, respectively. The overwhelming majority of 
students (87%) were White. Nearly two thirds (63%) of the students were considered 
freshmen, with less than 30 credit hours earned, versus sophomores. Of the 4,515 
enrolled students, 2,250 (49%) were enrolled in at least one online course. 
Disaggregation of demographic information by online enrollment was not provided. 

Course description. The course used to collect and analyze data was an online 
communications course in an associate's degree program offered using the Desire2Leam 
platform during Spring 2010. The instructor held a master's degree with nearly two 
decades of experience teaching communication courses at the post-secondary level. The 
instructor's amount of experience is relevant because an instructor's experience could 
influence the final design of the discussion prompts or at what point in the course 
different prompts are used. Requirements of the course included reading portions of the 
assigned textbook and lectures, participating in course discussions, completing quizzes 
and assignments, and participating in a group project. There were 21 students enrolled in 
the course. 
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Although the academic term was 17 weeks long, one week was a break with no 
course requirements. Of the remaining 16 weeks, discussions occurred in 10 of those 
weeks. With only one discussion prompt per week, and with Weeks 10 and 1 1 being 
combined under one discussion prompt, there was a total of nine discussion prompts. A 
total of 765 messages were posted, with the instructor posting 298 messages (39%) and 
students posting 467 messages (61%). Because the study focused on student-to-student 
interactions, three types of posts were not coded: initial posts from learners, messages 
posted from the instructor, and messages posted back to the instructor. While differences 
in a leamer‘s initial post could affect the level of intersubjectivhy in peer responses to 
that initial post, this variable is not under study in this research. The resulting number of 
qualifying posts was 167. 

Coding Procedure 

Access to the online course was granted by an administrator at the research site to 
a research assistant who extracted the text of the threaded discussions without identifying 
information about the institution or learners. Each discussion post was coded according to 
the three variables - cognitive requirement of prompt (CROP), time in course (TIC), and 
intersubjectivhy. 

Cognitive Requirement of Prompt (CROP). Bloom's revised taxonomy 
(Anderson et al., 2001) consists of a knowledge dimension (factual, conceptual, 
procedural, and metacognitive) and a cognitive process dimension (remember, 
understand, apply, analyze, evaluate, and create). Consistent with the method suggested 
by Anderson et al., the coding procedure considered the verb-noun combinations and 
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related the knowledge dimension with the process dimension. As mentioned in Chapter 

2, the knowledge dimension distinguishes categories of knowledge without distinctions 

of depth. Thus, the prompts were coded using the cognitive process dimension, which 

does address levels that are relative to one another as indicators of cognitive depth. 

CROP is the highest category in the cognitive process dimension that is required 

within the response to a discussion prompt. The selected level was marked on the 

transcript and in the data collection spreadsheet. Each category was coded as follows: 

Remember = 1, Understand = 2, Apply = 3, Analyze = 4, Evaluate = 5, and Create = 6. 

The discussion prompt for Week 8 serves as an example of how prompts are 

coded according to a level of Bloom's revised taxonomy. The Week 8 prompt was 

Your task is to rephrase the 5 conflict messages below into statements that use 
the b-c-f sequence of describing "behavior", describing "consequences" and 
describing "feelings." Your first step is to revise the 5 statements. Then describe 
"how" or "why" your changes have helped you apply a win-win assertive 
approach to the situation transforming a negative conflict situation into a more 
productive one that can be resolved. Einally put your 5 revised statements into 
your discussion group. Be sure to look at how other students have revised their 
statements and you'll learn from one another how to calm down conflicts using 
the bcf sequence. 

In accordance with the procedural knowledge dimension established by Anderson et al. 
(2001), this prompt asks about discipline-specific -eriteria for determining when to use 
appropriate procedures” (p. 46) in the form of -a- series or sequence of steps to be 
followed” (p. 52). The behavior-consequence-feelings sequence is part of the larger 
procedure of transforming a negative conflict situation into a more productive one. The 
cognitive process dimension for the prompt is the third level, apply, which Anderson et 
al. closely relate to the procedural knowledge dimension. The learner is asked to apply 
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the b-c-f sequence to the conflict messages in order to revise them into more productive 
communications. Thus, the Week 8 prompt is coded with “3.” 

There were a total of nine discussion prompts within the 10 weeks that required 
interaction through the discussion board, recalling that Weeks 10 and 1 Iwere combined 
under a single discussion prompt. All of the nine discussion prompts were coded within 
the lower three categories of Bloom's revised taxonomy: Remember (2 prompts). 
Understand (4 prompts), and Apply (3 prompts). Table 1 illustrates the level of Bloom's 
revised taxonomy coded for each week's discussion prompt. 


Table 1 

Taxonomy Level of Weekly Prompts 


Week(s) 

Taxonomy Level 

1 

Remember (1) 

3 

Understand (2) 

5 

Understand (2) 

6 

Understand (2) 

8 

Apply (3) 

9 

Remember (1) 

10-11 

Apply (3) 

12 

Apply (3) 

13 

Apply (3) 
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Time in Course (TIC). TIC was the amount of time that elapsed before a 
partieular message was posted to the discussion board and is presented as a percentage of 
course completion. This percentage was calculated by dividing the total number of 
calendar days completed prior to the date on which the message was posted by the total 
number of calendar days of the length of the academic term. The result was converted 
into a percentage and rounded to the nearest whole number. Since student-to-student 
discussions did not occur in the final three weeks of the course, and the week of spring 
break was not counted, the number of days in the term was 91 . 

For example. Message 62 was posted on March 26, which was Day 68 of the 
course. The number of calendar days completed prior to this date was 67, which is 
divided by the number of calendar days of the length of the academic term (91), resulting 
in a quotient of 0.736. When converted to a percent, the result is 73.6% and rounded to 
74%. Thus, the percentage of course completion for Message 62 is 74%. 

Each student-to-student post was coded for TIC by identifying the percentage of 
course completion, as explained in the preceding paragraph. A spreadsheet was used for 
easier calculation of the percentage, which was marked on the transcript and in the data 
collection spreadsheet. For clarity of illustration, the percentages are grouped in sets of 
10. Figure 4 provides the number of student-to-student posts per grouped percentage of 
course completion. 
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Figure 4 . Number of peer responses per pereentage of eourse eompletion. 

Intersubjectivity. In terms of eourse room diseourse, intersubjeetivity is the 
representation of knowledge eonstruetion achieved through a synergistic progression 
from individual contributions to sequences of interdependent contributions. The 
instrument selected to measure intersubjeetivity within the discussion threads of the 
online course is the Interaction Analysis Model (lAM) developed by Gunawardena et al. 
(1997) and presented in Appendix A. 

The first category of the lAM, sharing and comparing, involves a statement of 

observation or opinion; statement of agreement; corroborating examples; asking and 

answering questions to clarify details of statements; or the definition, description, or 

identification of a problem. An example of a post coded in thi s category is Message 44: 

I vote for [organization] too. I just looked at the website and wow. Lets do 
something for them if we can. My vote is for them. . .If we pick them, then what 
would we do for them? that is where Tm confused. 
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This post offers a statement of agreement beeause the learner voted for the same 
organization and asked a question for clarification of the task. Thus, this message is 
coded with a on the lAM. 

The second category of the Interaction Analysis Model (lAM), dissonance, 
involves identifying and stating areas of disagreement; asking and answering questions to 
clarify the source and extent of disagreement; or restating the participant‘s position, 
possibly through advancing arguments with references to the learner's experience, 
literature, formal data collection, or the proposal of a relevant metaphor or analogy to 
illustrate a particular point of view. An example of a post coded in this category is 
Message 63; 

I was thinking that our focus/thesis should be on the food and clothing services 
[organization] provides and why they are important, and that we must persuade 
the audience to support them. For my portion of the presentation, I am planning to 
share personal stories of the children Tve had in foster care who has used the 
[organization], as well as some stats on homeless people/youths in [city]. I hope 
to have my work posted here tonight, with any luck. 

This message was posted in response to a learner who suggested a different focus for a 

group project. Thus, Message 63 identified and stated areas of disagreement between two 

members of the group. The author of this message supported this focus through reference 

to personal experience and formal data collection. Thus, this message was coded with a 

from the lAM. 

The third category of the Interaction Analysis Model (lAM) is negotiation and co- 
construction. This category involves negotiation or clarification of the meaning of terms, 
negotiation of the relative weight to be assigned to arguments identification of areas of 
agreement or overlap among conflicting concepts, proposal and negotiation of new 
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statements embodying compromise, co-construction, and proposals integrating or 
accommodating metaphors or analogies. Message 148 was an example of a post coded in 
this category. 

If we decide to go with the idea of our goal being to inspire the audience that 
[organization] is worth investing in, I would go in that direction. Maybe start with 
a little history and what they‘re all about. Maybe just briefly touch on how they 
are able to provide services to all children, regardless of income. 

The author of this message negotiated the content of the group presentation by proposing 

elements that were similar to those in the previous message as well as elements that were 

in addition to the contents in the previous message. Thus, the message was coded with a 

for the third category of the lAM. None of the posts was coded in Phase 4 (testing 

tentative constructions) or Phase 5 (statement and application of newly constructed 

knowledge). The number of student-to-student posts coded in each stage of the lAM is 

provided in Table 2. 


Table 2 

Peer Posts Per Phase of lAM 


lAM Phase 

# Peer 
Responses 

1 Sharing & Comparing 

141 

2 Dissonance 

23 

3 Negotiation & Co-Construction 

3 

4 Testing Tentative Constructions 

0 

5 Statement & Application of 
Newly Constructed Knowledge 

0 
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Consistent with coding practices used in previous studies (Beaudrie, 2000; 
Luebeck & Bice, 2005; Moore & Marra, 2005; Onrubia & Engel, 2005), each post was 
coded according to the highest phase of the lAM present within the response. Thus, a 
post that indicated different phases was assigned a single code according to the highest 
phase represented in the response. An example is Message 128; ^believe our audience 
would be our memebers [sic] of the class.” While this message does state an observation 
or opinion, consistent with the first level of sharing and comparing, the post also 
identifies an area of disagreement, which is consistent with the second level of 
dissonance. Thus, the post is coded with the higher level “2.” 

Inter-Rater Reliability 

Inter-rater reliability is an important measure of control within data coding. Data 
in the study were coded by the researcher and an assistant who had coding experience 
and was trained in the application of the Interaction Analysis Model (lAM) and the data 
collection spreadsheet. Krippendorff s alpha (Hayes & Krippendorff, 2007) was used 
because this measure is functional in content analysis with any number of ratings, levels 
of measurement, or size of sample. Posts (167 peer posts and nine discussion prompts) 
were separately coded and then compared. The initial Krippendorff alpha for the nine 
discussion prompts (cognitive requirement of prompt, CROP) was 0.891, and the alpha 
for the 167 peer posts (intersubjectivity) was 0.914, both of which exceed 0.8, the 
minimum threshold of acceptable reliability (Artstein & Poesio, 2005). 


80 



Data Analysis 


The data collected in this study were analyzed using both descriptive and 
inferential statistics. The data collected are from categorical, or nominal, scales and 
KendalTs tau-c was used for analysis. This non-parametric statistical calculation avoids 
assumptions about frequency distributions and linearity of relationship (Creswell, 2008). 
Furthermore, the calculation makes adjustments for ties in the data and is appropriate 
when the number of categories for each variable is unequal (Agresti, 2010). In this 
study, the variable time in course (TIC) has 10 categories, cognitive requirement of 
prompt (CROP) has six categories, and intersubjectivity has five categories. The 
analyses are reported in order of the research question. 

CROP and Intersubjectivity: Research Question 1 

The first research question asked, -What is the association between 
intersubjectivity and CROP within the threaded discussions of online course rooms?” 
Table 3 shows the number of posts coded in each phase of the Interaction Analysis Model 
(lAM) and level of Bloom's revised taxonomy. Since there were no discussion prompts 
at Levels 4, 5, or 6 of Bloom's taxonomy or peer responses at Phases 4 or 5 of the lAM, 
these categories have been omitted from the table. 
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Table 3 

Cognitive Requirement of Prompt Per Phase of lAM 


lAM Phase 

1 

Remember 

2 

Understand 

3 

Apply 

1 Sharing & Comparing 

35 

7 

99 

2 Dissonance 

1 

1 

21 

3 Negotiation & Co- 
Construction 

0 

0 

3 


The null hypothesis for Question 1 was that there is no relationship between 
cognitive requirement of prompt (CROP) and intersubjectivity. The value of Kendall‘s 
tau-c was 0.091 with a level of significance at 0.001 . As illustrated in the scatterplot in 
Figure 5, as cognitive requirement of prompt (CROP) increases, so does intersubjectivity, 
indicative of a positive correlation. Thus, the null hypothesis was rejected in favor of the 
alternate hypothesis that there is a relationship between intersubjectivity and cognitive 
requirement of prompt (CROP). There is a positive association between intersubjectivity 
and CROP within the threaded discussions of online course rooms. Because the scales 
for intersubjectivity and CROP used integers, with no fractions, what appears to be only 
one point on the graph actually represents multiple points at the exact same location on 
the graph. 
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CROP 1 

CROP 2 

CROPS 

CROP 1 

CROP 2 

CROPS 

CROP 1 

CROP 2 

CROPS 

lAM 1 

IAM2 

lAMS 


Figure 5. Histogram for cognitive requirement of prompt (CROP) and intersubjectivity, 
as measured using the Interaction Analysis Model (lAM). 


TIC and Intersubjectivity: Research Question 2 

The seeond research question asked, -What is the association between 
intersubjectivity and TIC within the threaded discussions of online course rooms?” 
Intersubjeetivity was measured using the Interaction Analysis Model (lAM), and time in 
course (TIC) was measured using percentage of course eompletion. The contingeney 
table is provided in Table 4. Sinee there were no responses at Phases 4 or 5 of the lAM, 
these categories have been omitted from the table. 
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Table 4 

Percentage of Course Completion and Phase of lAM 


% Complete 

1 Sharing & 
Comparing 

2 Dissonance 

3 Negotiation & 
Co-Construction 

0-9 

15 

2 

0 

10-19 

5 

0 

0 

20-29 

0 

0 

0 

30-39 

1 

0 

0 

40-49 

3 

1 

0 

50-59 

1 

0 

0 

60-69 

15 

0 

0 

70-79 

67 

11 

3 

80-89 

19 

8 

0 

90-99 

15 

1 

0 

Totals 

141 

23 

3 


The null hypothesis for Question 2 was that there is no relationship between time in 
course (TIC) and intersubjectivity. The value of Kendall's tau-c was 0.096 with a 
significance level of 0.032. As illustrated in the histogram in Figure 6, as time in course 
(TIC) increases, so does intersubjectivity, indicative of a positive correlation. Thus, the 
null hypothesis was rejected in favor of the alternate hypothesis that there is a 
relationship between intersubjectivity and time in course (TIC). There is a positive 
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association between intersubjectivity and TIC within the threaded diseussions of online 
course rooms. 



Figure 6. Phase of lAM (intersubjectivity) per pereentage of course eompletion (TIC). 


Summary 

An explanatory eorrelational design was used to measure the relationships 
between (a) cognitive requirement of prompt and (b) time in course within the threaded 
discussions of an online course room. All of the peer responses were studied from an 
aceredited, online course in Communication offered during Spring 2010 through a 
eommunity college in the Midwestern region of the United States. Nine discussion 
prompts were coded using Bloom‘s revised taxonomy to measure the construct of 
cognitive requirement of prompt (CROP). The 167 student-to-student responses were 


coded using the Interaction Analysis Model (lAM). Inter-rater reliability was measured 
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using Krippendorff s alpha, which revealed levels of agreement above the minimum 
threshold for quality assurance. 

A positive relationship was found between CROP and intersubjectivity. Thus, 
changes in the cognitive processing requirement of the discussion prompts corresponded 
with ehanges in the learners ‘ responses to their peers. Time in course (TIC) was 
ealculated as the percentage of course eompletion prior to the day on whieh a message 
was posted. As with cognitive requirement of prompt (CROP), a positive relationship 
was found also between time in eourse and intersubjectivity. That is, changes in the 
different levels of interaction within peer responses corresponded with different points of 
time within the course. The findings of this study, that there are positive relationships 
between 1) CROP and intersubjectivity and 2) TIC and intersubjectivity, inform the work 
of instruetional designers in several ways. These implications are explored further in the 
next chapter. 
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CHAPTER 5. RESULTS, CONCLUSIONS, AND RECOMMENDATIONS 


In a survey of research articles in the 20th century, Berge and Mrozowski (2001) 
concluded that one of the three topics addressed most often was how to increase 
interactivity. Gunawardena et al. (1997) defined interaction as -the process through 
which negotiation of meaning and the co-creation of knowledge occurs” (p. 407). This 
study focused on discussion boards, which have been called the 4ife blood and center of 
energy” for the online course (Makitalo-Siegl, 2009, p. 55) because the threaded 
discussions are the most common space in which collaborative knowledge construction is 
demonstrated (Calvani et ah, 2010). 

Successful knowledge construction requires -active and broad participation” 

(Sing & Khine, 2006, p. 254) occurring at a higher level than surface interaction, as noted 
by Dennen and Wieland (2007). Knowledge construction at this more advanced level of 
interaction occurs through the opportunities for cognitive engagement required for the 
higher-order learning processes indicated by Bloom's taxonomy (Bloom & Krathwohl, 
1956). As Jerolmack (2009) pointed out, interaction does not require the shared 
understandings or intentions implicit in intersubjectivity. While interaction is inherent in 
all the forms of constructivist learning, intersubjectivity takes interaction to a higher level 
(Dennen & Wieland, 2007; Martin et al., 2008). 

With past research indicating that the content of discussion posts overall range 
from substantive to irrelevant, the problem investigated by this study was the lack of 
consistent quality in discussion board interactions. The purpose of the study was to 
investigate the relationships between intersubjectivity, as a measure of the quality of 
interaction in course room discourse, and (a) cognitive requirement of prompt and (2) 
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time in course within the threaded discussions of an online course room. There were two 


research questions. 

1 . What is the association between intersubjectivity and cognitive requirement of 
prompt within the threaded discussions of online course rooms? 

2. What is the association between intersubjectivity and time in course within the 
threaded discussions of online course rooms? 

An explanatory correlational design was used to measure the relationships 
between the variables. Content analysis, specifically the Interaction Analysis Model 
(lAM) of Gunawardena et al. (1997) was used to measure the intersubjectivity of student 
responses posted to the discussion boards. The cognitive requirement of prompt (CROP) 
was determined by the level of cognitive processing, according to Bloom‘s revised 
taxonomy (Anderson et al., 2001), required in a learner's response to the prompt. Time in 
course (TIC) was calculated as the percentage of time that had elapsed between the 
beginning of the course term and the date on which a message was posted. 

This chapter is organized into five sections. The first discussion explores the 
findings of the study, in order of research question, followed by a discussion of the 
significance of the study to the field of instructional design. The next discussion notes 
the limitations of the study, followed by suggestions for future research. A final 
conclusion summarizes the most significant elements of the study. 

Discussion of Findings 

The data analyzed in the previous chapter are interpreted in this discussion of the 
findings, which is divided according to research question. 
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CROP and Intersubjectivity: Research Question 1 

In terms of course room discourse, intersubjectivity is the representation of 
knowledge construction achieved through a synergistic progression from individual 
contributions to sequences of interdependent contributions. Intersubjectivity within the 
discussion threads was measured using the Interaction Analysis Model (lAM) developed 
by Gunawardena et al. (1997) and presented in Appendix A. An effective means of 
determining the level of cognitive process is Bloom‘s taxonomy (Jorgensen, 2009). 
Cognitive requirement of prompt (CROP) was defined as the highest category in the 
cognitive process dimension of Bloom‘s revised taxonomy (Anderson et ah, 2001) that 
was required within the response to a discussion prompt. 

The first research question asked, -What is the association between 
intersubjectivity and CROP within the threaded discussions of online course rooms?” In 
other words, this research question examined if there was a correlation between the level 
of intersubjectivity within peer responses and the level of cognitive thought required by 
the initial discussion prompt. The results of the study indicate a weak but significant 
positive relationship between intersubjectivity and CROP. Thus, higher levels of 
interaction within peer responses corresponded with higher level cognitive processes 
according to Bloom's revised taxonomy (Anderson et ah, 2001). For example, a 
discussion prompt requiring a response at Bloom's first level (remember) was associated 
with a peer response at the first level of the lAM (sharing and comparing). Likewise, just 
as there were no discussion prompts at the higher levels of Bloom's revised taxonomy, 
there were no peer responses at the higher levels of the lAM. 
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The findings of this study uphold the assertions and conclusions of other scholars. 
According to Lim (2004), the communication that occurs in any learning environment is 
the most important aspect of the educational process that happens in that environment. In 
the online learning environment designed within a constructivist framework, the majority 
of the dialogue occurs through the discussion boards (Jeong, 2003; Schwartman, 2006; 
Thompson, 2009). The results of this study support the assertions of Calvani et al. (2010) 
that the interaction that occurs within threaded discussions is important to achieving the 
learning objectives of instruction situated within a constructivist environment, and of 
Thomas (2002), that learners who engage these discussion boards may be able to achieve 
a high level of cognitive processing. 

The study reinforces Wang‘s (2005) definition of a question as a particular kind 
of prompt that directs student thinking through productive discussion. In particular, this 
study supports Wang‘s assertion that the 4evel of student thinking is directly 
proportional to the level of questions asked” (p. 310) and that knowledge construction 
occurs through responding to high-level questions. These findings are consistent with 
those of Rosenshine and Meister (1992) and Wruck (2010), who suggested that there are 
different ways to design prompts, as instructional devices or strategies, which influence 
student thinking. 

Consistent with the suggestion of Donnelly (2010) that the multitude of low-level 
messages might be a result of the design of the discussion forum and the questions that 
are posed to stimulate discussion, this study supports the assertion of Tu and Corry 
(2003) that effectively planning the use of discussion boards is important in achieving a 
high level of cognitive engagement. Furthermore, the study supports the conclusions of 
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Asherian (2007) and DeLoach and Greenlaw (2007) that one element of planning for 
eognitive engagement is the design of the initial diseussion prompts and the more firm 
assertion of Chin (2004) that earefully designed questions are required tools for 
eognitively engaging students. 

TIC and Intersubjectivity: Research Question 2 

TIC is the amount of eourse time that has elapsed before a particular message was 
posted to the discussion board, as indicated by percent of course completed at the time 
the response is made. The abundance of courses with varying lengths makes it difficult 
to examine intersubjectivity along these multiple points and across courses. The 
calculation of percentage of course completion” makes possible accurate comparisons 
across courses of different lengths. 

The second research question asked, -What is the association between 
intersubjectivity and time in course within the threaded discussions of online course 
rooms?” In other words, this research question examined if there was a correlation 
between the level of intersubjectivity within peer responses and the amount of time that 
had elapsed in the course term (TIC). The results of the study indicate a weak but 
significant positive relationship between intersubjectivity and TIC. Thus, higher levels of 
intersubjectivity were observed later in the course. 

Consistent with previous research (Daniel, 2000; Kretovics, Crowe, & Hyun, 

2005 ; Seaman, 2004), Anastasi (2007) found that academic performance and course 
evaluations were consistent between courses offered in traditional and accelerated terms. 
Combined with the findings of Kucsera and Timmaro (2010) and Poellnitz (2008) that 
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instructors' effectiveness was equivalent between traditional and aeeelerated courses, the 
total length of the course did not present a eonfounding variable. 

The eurrent study refutes the findings of Christopher et al. (2004), who found no 
pattern of ehange in the level of thinking that oeeurred over a semester-long eourse. 
Instead, the study supports the tangential findings of Boulter (2010), who noted a small 
but signifieant indieation that the depth of eritieal thinking exhibited within discussions 
increased toward the end of an 1 1 -week eourse in both the treatment and eontrol groups. 

In summary, the findings of this study revealed two things. One aeeomplishment 
of these findings is the support of the results from previous studies of similar variables. 
This support is partieularly evident in the case of cognitive requirement of prompt 
(CROP) because of the large number of published studies on the use of questions in 
eognitive engagement than the number of studies published with variables similar to time 
in course (TIC). Also, the study provided data about two unique eorrelations that had not 
been studied previously. The signifieanee of these findings is diseussed next. 

Significance to the Field of Instructional Design 

Despite the extensive research conducted sinee the end of the last century and 
detailed within the literature review in Chapter 2, quality in online discourse remains 
ineonsistent and ephemeral. As online eourse delivery continues to grow (Allen & 
Seaman, 2010), the ehallenge for instruetional designers is the identifieation and 
implementation of those course elements whieh faeilitate intersubjeetivity in online 
courses. This study examined two sueh elements: the cognitive requirements of prompts 
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(CROP) used to elicit learner responses and the points of time within the course (TIC) of 
the peer responses. 

The findings of this study, that significant positive relationships exist between 
CROP and intersubjectivity and between TIC and intersubjectivity, inform the work of 
instructional designers in several ways. The value of the initial prompt designed to 
stimulate each threaded discussion is greater than the singular focus on soliciting 
leamers‘ summaries and reflections. This study shows the importance of considering the 
cognitive process level at which a learner response is expected and the opportunity that 
the prompt creates for dissonance, resolution, and the construction of knowledge during 
instructional design. While discussion prompts at all levels of Bloom's revised taxonomy 
are valid, designers should be particularly cognizant of the alignment between the 
learning objectives of each course segment and the cognitive process level of the prompt 
that frames the development of the threaded discussion that follows. The initial prompt is 
one of the first pieces of scaffolding necessary for the knowledge construction requisite 
in a constructivist learning environment. Instructional designers should continue to 
recognize that the strength of the construction of knowledge, as evidenced in the threaded 
discussion, depends upon the strength of the scaffolding that supports that construction. 

If the scaffolding, as in the initial prompt, is weak, the knowledge construction may 
vacillate and fail to meet the learning objective. 

Limitations of the Study 

Although the study has produced useful and significant findings for the field of 
instructional design, the results of the study include several limitations. 
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The first limitation of the study is related to the assumptions on whieh it rests. 

One assumption of the study is the validity of the theoretical framework. The study is 
framed by social constructionism, a learning theory the lineage of which can be traced 
from Kant (1781/2007) through Piaget (1952), Vygotsky (1978), and Paper! (1991). The 
results of this study are valid only to the extent to which the social constructionism is 
considered a valid learning theory. The manifestation of and ability to detect evidence of 
knowledge construction within course room discussions are further assumptions. That is, 
the results of the study are limited by their dependence on the assumption that knowledge 
construction occurs within course room discourse and that these occurrences can be 
detected. Another assumption of the study is that the design of the instruction influences 
the extent of knowledge construction that occurs within these discussions. The findings 
of this study would be invalid if knowledge construction were independent of 
instructional design factors. 

Another limitation is related to the characteristics of the course under study. Only 
one course was examined, resulting in 167 peer responses. Thus, the results of the study 
may be specific to the characteristics of the institution, course, instructor, or learners 
within this one course. A different size course, or multiple courses, might have produced 
different results. The discipline of the course was communications, so interactions might 
be different in courses from other disciplines. Likewise, peer interaction could be 
different at four-year institutions versus two-year institutions, or at the graduate versus 
undergraduate level. For example, learners in four-year program would have had more 
academic experience than their peers in two-year programs; likewise, learners in a 
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graduate program would have had more experience than learners in an undergraduate 


program. 

The student characteristics represent another potential limitation. Age is one 
characteristic that may have limited the study. The age of the students who were enrolled 
in the course could have affected their levels of life experience upon which to draw 
reflections and share insights. For example, one student was participating in a dual 
enrollment program between high school and college. While the institution‘s entire 
enrollment was divided equally between traditional students (Age 24 and younger) and 
non-traditional students (Age 25 and older), nearly two thirds of all students enrolled 
were considered freshmen in the first year of the two-year program. Though this 
information is known at the institutional level, the age and status of those students in the 
course under study is unknown. Different levels of life experience could affect the ability 
of the students to engage the discussion topics at a deep level, to recognize and resolve 
dissonance, and to co-construct knowledge related to the course themes. The coordination 
of perspectives evidenced within the content of the message is what determines whether 
or not intersubjectivity has been achieved (Dennen & Wieland, 2007; Wertsch, 1985). 
Thus, without multiple perspectives, there is no coordination to lead to intersubjectivity. 

Ethnic diversity, or lack thereof, is another limitation related to student 
characteristics. About nine out of 10 students enrolled at the university were White. 
Although it is not being suggested that all Whites have similar life experiences, the 
limited ethnic diversity that can be extrapolated from the institutional enrollment to the 
course enrollment could have contributed to a lack of dissimilar experiences with which 


95 



to approach problems, challenge ideas, create dissonanee, and envision a new perspeetive 
required for the co-ereation of knowledge. 

Another limitation is the explanatory correlational design, whieh measures the 
degree of assoeiation between the variables of intersubjectivity, cognitive requirement of 
prompt (CROP), and time in course (TIC), but offers no predietive or eausal deseriptions. 
Thus, while a correlation does exist, the correlation does not suggest that writing 
discussion prompts which require higher levels of cognitive proeessing causes higher 
levels of intersubjeetivity within the peer responses. 

A final limitation is the fact that the discussion board does not capture all of the 
cognitive processes of the learners. A learner may engage a peer's post at a higher level 
of eognitive processing than the learner reeords within the threaded discussion. The 
positive relationship between cognitive requirement of prompt (CROP) and 
intersubjeetivity might be even stronger if all of a learner's cognitive proeessing were 
eaptured through the discourse. Thus, the extent of the positive relationship found in this 
study is limited by the inability to eneapsulate eompletely the eognitive processing of 
individual learners. 


Suggestions for Future Research 

The eonelusions of this study stimulate more questions than the study answers. 
Thus, there are many directions for future research. 

One direction is to consider how the technology platform might influence the 
studied variables. Ligorio et al. (2008) noted that tools, whieh would include delivery 
platform, are part of -die arehitecture sustaining intersubjeetivity" (p. 352). The course 
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in this study used the Desire2Learn platform. Are there differenees in the variables when 
the prompts are similar but the platform is different? Of eourse, the great debate by Clark 
(1983, 1994, 2001) and Kozma (1994a, 1994b, 2000) supposedly settled questions about 
media and methods, and Sims (1997) summarized the popular viewpoint that — quhty in 
an instruetional resource is a function of the design effort, not the technology” (p.l58). 
Yet, the navigational requirements of different learning management systems could affect 
a learner's cognitive load and influence the learner's cognitive processing and written 
responses. 

Additional information is needed about how intersubjectivity, cognitive 
requirement of prompt, and time in course might differ according to academic program 
level, such as associate, bachelor's, master's, or doctoral degrees. Certificate programs 
or non-doctoral terminal degrees might also be fruitful places to explore. Even secondary 
courses are worth studying in this regard, as Ash's (2011) work with at-risk, high school 
students revealed that they found their peers' responses valuable and motivational in their 
own learning. 

Another area for future research relates to the idea of quality peer interaction. 
Perhaps quality, like beauty, is in the eye of the beholder. An instructional designer and 
participant in a study by Ashbaugh (2011) suggested that -the majority of the instruction 
is going to remain inferior” (p, 158) if quality does not become the focus of attention in 
the field of online instructional design. But what does quality look like? Parker (2004) 
accurately stated that -die greatest challenge for trying to define quality in any product or 
service is that quality remains a relative experience, realized in large part through an 
individual's level of expectation” (p. 387). Thus, future research could consider the 
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relationships among various objective measures of quality, in terms of course outcomes, 
and the expectations of instructional designers, online classroom facilitators, and learners. 

Differences in individual courses, disciplines, and institutions could also be 
reviewed. Future studies could examine multiple courses to create a larger pool of data. 
In order to gain information about intersubjectivity within specific courses or disciplines, 
additional research could compare similar courses within the same discipline or compare 
courses in different disciplines. Such comparisons could be made within a single 
institution or between multiple institutions. 

Since each week of the current study had only one discussion prompt, future 
research might consider courses with multiple prompts during each segmentation, such as 
week or unit. How might intersubjectivity change if there were two or three prompts 
each week? Does it make a difference if each week has the same number and type of 
prompt or different numbers of prompts? This research could be extended even into an 
examination of how the cognitive process levels of multiple prompts within the same 
week were associated with one another or with other variables like intersubjectivity. 

A final area of potential research discussed here relates to learner persistence in 
online courses. If learner engagement leads to greater persistence, and if high levels of 
peer interaction contribute to such learner engagement and motivation, as suggested by 
Moore and Kearsley (2005), then what role might the discussion prompts play in 
persistence? Given the continued findings that persistence rates in online environments 
range from 10 to 20 percentage points lower than in their brick-and-mortar counterparts 
(Hershkovita & Nachmias, 2011), the influence on learner persistence of instructional 
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design factors such as cognitive requirement of prompt and time in course is an 
interesting area of potential research. 


Conclusion 

A call for a paradigm shift in education from the instructor-centered model 
focused on the dissemination of knowledge to the learner-centered model focused on the 
construction of knowledge has echoed since the second half of the last century (Reigeluth 
& Carr-Chellman, 2009). Concurrent with this was Gibson‘s (2009) assertion that 
discussion-based teaching ^verses the focus of the industrial-age paradigm by 
emphasizing learning as the priority, not teaching” (p. 102). This study examined two 
elements of course design that were associated with peer responses with threaded 
discussions. Both cognitive requirement of prompt (CROP) and time in course (TIC) 
were found to have weak but significant correlations with intersubjectivity, a measure of 
quality in online classroom discourse. Though there were limitations to this study and 
many opportunities to extend the current research, instructional designers should continue 
to consider how the design of initial prompts and the placement of those prompts 
throughout the course will relate to the learner's ability to summarize, share, challenge, 
and construct knowledge within a constructivist learning environment. On a final note, 
the multiple meanings drawn from the multidisciplinary roots of the term intersubjectivity 
could be cumbersome when discussing the construct within this specific context. Thus, 
consideration could be given to an alternate label such as reciprocal responses, shared 
cognition, or response connectivity. 
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APPENDIX A, INTERACTION ANALYSIS MODEL (lAM) 


Phase Category Indieators 

1 Sharing & • Statement of observation or opinion 

Comparing • Statement of agreement 

• Corroborating examples 

• Asking and answering questions to elarify details 
of statements 

• Definition, deseription, or identifieation of a 

problem 

2 Dissonanee • Identifying and stating areas of disagreement 

• Asking and answering questions to elarify the 
source and extent of disagreement 

• Restating the participant‘s position, and possibly 
advancing arguments or considerations in its 
support by references to the participant‘s 
experience, literature, formal data collected or 
proposal of relevant metaphor or analogy to 

illustrate point of view 

3 Negotiation & • Negotiation or clarification of the meaning of terms 

Co-Construction • Negotiation of the relative weight to be assigned to 

arguments 

• Identification of areas of agreement or overlap 
among conflicting concepts 

• Proposal and negotiation of new statements 
embodying compromise, co-construction 

• Proposals integrating or accommodating metaphors 
or analogies 

4 Testing Tentative • Testing the proposed synthesis against Received 

Constructions fact‘ as shared by the participants and/or their 

culture 

• Testing against existing cognitive schema 

• Testing against personal experience 

• Testing against formal data collected 

• Testing against contradictory testimony in the 
literature 

5 Statement & • Summarization of agreement(s) 

Application of • Applications of new knowledge 

Newly Constructed • Metacognitive statements by the participants 

Knowledge illustrating their (cognitive schema) has changed as 

a result of the interaction 
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Note. From — Aalysis of a global online debate and the development of an interaction analysis model for 
examining the social construction of knowledge in computer conferencing,” by C.N. Gunawardena, T. 
Anderson, and C.A. Lowe, 1997, Journal of Educational Computing Research, 77(4), p. 414. Copyright 
1997 by the Baywood Publishing Company. Adapted with permission. 
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